-- Logs begin at Wed 2022-09-28 11:41:10 UTC, end at Wed 2022-09-28 12:48:17 UTC. -- Sep 28 12:13:56.844346 dv-cinder-844563-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:13:56 2022] *** Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: nodename: dv-cinder-844563-9-iscsi Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: machine: x86_64 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: clock source: unix Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: pcre jit disabled Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: detected number of CPU cores: 4 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: current working directory: / Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: your processes number limit is 47680 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: your memory page size is 4096 bytes Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: detected max file descriptor number: 2048 Sep 28 12:13:56.856111 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: lock engine: pthread robust mutexes Sep 28 12:13:56.857515 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: thunder lock: enabled Sep 28 12:13:56.857515 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 12:13:56.857515 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:13:56.894928 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: Python main interpreter initialized at 0x55caaa65f9c0 Sep 28 12:13:56.894928 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: python threads support enabled Sep 28 12:13:56.894928 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: your server socket listen backlog is limited to 100 connections Sep 28 12:13:56.894928 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:13:56.895256 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:13:56.895332 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: *** Operational MODE: preforking *** Sep 28 12:13:56.895568 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:13:56.895568 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: spawned uWSGI master process (pid: 105397) Sep 28 12:13:56.895750 dv-cinder-844563-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 12:13:56.897464 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: spawned uWSGI worker 1 (pid: 105398, cores: 1) Sep 28 12:13:56.897464 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: spawned uWSGI worker 2 (pid: 105399, cores: 1) Sep 28 12:13:56.897464 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:13:57.557019 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:13:57.557672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:13:58.642607 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:58.642607 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: from cryptography.utils import int_from_bytes Sep 28 12:13:58.643227 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:58.643227 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: from cryptography.utils import int_from_bytes Sep 28 12:13:58.643354 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:58.643354 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: from cryptography.utils import int_from_bytes Sep 28 12:13:58.643778 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:58.643778 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: from cryptography.utils import int_from_bytes Sep 28 12:14:01.120636 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:14:01.121232 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:14:01.121438 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:14:01.121551 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:14:01.121913 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:14:01.121998 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:14:01.122087 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:14:01.122321 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:14:01.122418 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.122683 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:14:01.122772 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.122936 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:14:01.123030 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.123306 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.123404 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.123625 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.123716 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.123929 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124021 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124236 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124336 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124550 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124640 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124856 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.124947 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125114 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125240 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125445 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125544 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125764 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-9-iscsi {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.125859 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126058 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126195 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126368 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126472 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126670 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126770 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-9-iscsi {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.126986 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127077 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127284 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127374 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127590 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127688 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.127903 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128043 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128191 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128395 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128509 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128796 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.128918 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.129125 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.129322 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.129462 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.129641 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.129824 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130008 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130101 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130259 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130416 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130541 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130664 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130851 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.130967 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131155 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131284 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131470 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131586 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131772 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.131974 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-9-iscsi {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132087 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132283 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132378 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132589 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132768 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-9-iscsi {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.132896 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.133119 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.133457 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.133579 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.133766 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.133891 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.134182 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.134512 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.134640 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.134834 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.135317 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.135414 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.135666 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.135767 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.135986 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136079 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136305 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136440 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136620 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136775 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.136968 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.137125 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.137374 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.137486 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.137683 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.137821 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138052 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138357 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138444 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138659 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138748 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.138908 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139065 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139210 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139394 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139528 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139710 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.139848 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140024 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140166 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140326 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140466 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140582 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140677 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.140908 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141002 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141257 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141362 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141562 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141646 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141830 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.141935 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142084 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142179 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142407 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142493 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142723 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.142820 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143023 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143110 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143321 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143417 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143620 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.143925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144017 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144231 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144315 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144537 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144624 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144838 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.144933 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145182 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145272 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145491 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145580 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145784 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.145867 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146085 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146171 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146413 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146502 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146723 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.146818 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147025 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147122 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147346 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147433 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147653 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147744 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.147951 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.148042 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.148252 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.148344 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.148552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.149299 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.149412 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.149672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.149811 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150000 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150088 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150256 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150350 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150639 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150850 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.150942 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151164 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151256 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151463 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151551 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151763 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.151866 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152060 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152354 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152452 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152654 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152748 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.152954 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153048 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153276 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153376 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153575 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153661 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153873 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.153968 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154173 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154270 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154559 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154766 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.154868 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155066 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155153 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155365 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155452 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155667 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155767 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.155973 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156059 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156272 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156403 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156569 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156671 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156868 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.156956 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157189 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157280 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157507 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157612 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157813 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.157901 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158112 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158199 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158414 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158513 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158716 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.158802 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159012 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159099 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159326 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159426 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159626 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159724 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.159926 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160012 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160239 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160333 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160535 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160833 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.160920 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161154 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161253 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161466 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161560 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161766 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.161861 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162063 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162158 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162361 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162454 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162658 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162751 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.162956 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163044 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163249 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163335 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163548 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163634 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163842 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.163930 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.164144 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.164243 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165031 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165237 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165360 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165647 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165765 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.165947 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.166071 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.166261 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.166374 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.166568 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.166683 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.166893 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.167017 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.167217 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.167338 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.167524 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.167642 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.167828 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.167947 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.168134 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.168254 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.168455 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:01.168575 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.168760 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.168881 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169069 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169202 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169413 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169526 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169718 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.169844 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170023 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170136 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170384 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170500 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170634 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170754 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.170922 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171016 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171248 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171346 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171559 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171644 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171867 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.171962 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172178 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172274 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172486 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172575 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172795 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.172881 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173113 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173229 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173448 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173535 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173751 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.173882 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174082 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174204 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174420 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174506 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174729 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.174824 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175049 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175145 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175364 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175459 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175670 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175757 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.175975 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176077 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176280 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176373 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176613 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176706 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.176919 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177006 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177245 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177335 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177558 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177647 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177869 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.177957 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178183 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178275 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178489 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178577 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178792 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.178870 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179098 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179175 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179403 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179480 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179707 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.179786 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180063 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180148 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180429 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180544 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180745 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.180841 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181054 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181203 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181386 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181473 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181697 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.181772 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182002 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182123 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182309 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182437 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182617 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182739 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.182918 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183030 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183218 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183345 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183520 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183634 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183826 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.183939 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184127 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184442 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184528 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184753 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.184840 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185053 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185167 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185382 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185688 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.185784 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186083 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186171 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186392 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186486 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.186861 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187047 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187200 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187355 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187660 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187829 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.187979 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188128 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188272 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188414 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188560 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188706 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.188891 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189055 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189290 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189438 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189584 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189718 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.189872 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190013 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190170 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190309 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190473 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190611 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190765 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.190907 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.191054 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.191435 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.191590 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.191736 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.191898 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192039 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192178 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192319 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192468 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192637 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192797 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.192947 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193090 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193490 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193653 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193801 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.193948 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194089 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194219 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194345 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194501 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194501 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194774 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194933 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.194933 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195114 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195207 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195315 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195487 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195657 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195807 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.195971 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196069 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196369 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196456 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196666 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196752 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.196963 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197051 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197284 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197393 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197582 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197669 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197896 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.197984 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198203 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198289 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198500 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198586 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198797 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.198893 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199093 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199181 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199396 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199491 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199702 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.199790 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200007 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200093 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200331 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200426 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200641 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200729 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.200944 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201032 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201270 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201459 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201574 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201661 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201876 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.201961 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202181 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202278 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202486 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202572 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202790 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.202877 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203104 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203204 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203409 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203497 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203734 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.203874 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204027 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204115 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204345 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204441 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204648 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204743 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.204954 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205041 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205287 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205420 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205599 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205726 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205906 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.205995 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206227 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206314 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206536 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206622 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206851 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.206939 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207156 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207244 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207464 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207567 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207768 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.207854 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208074 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208159 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208381 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208476 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208683 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208770 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.208995 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209082 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209322 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209419 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209635 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209721 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.209939 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210027 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210259 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210354 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210563 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210650 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210871 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.210956 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.211696 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.211797 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212008 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212094 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212409 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212495 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212728 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.212816 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213040 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213180 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213390 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213476 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213699 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.213788 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214004 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214090 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214307 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214430 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214612 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214699 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.214912 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215008 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215212 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215299 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215518 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215605 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215827 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.215913 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216131 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216226 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216454 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216542 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216738 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.216823 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217047 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217159 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217374 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217474 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217674 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217760 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.217972 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218068 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218278 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218366 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218584 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218677 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218894 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.218993 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219197 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219284 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219512 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219600 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219812 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.219899 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220114 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220199 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220416 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220511 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220718 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.220804 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221016 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221103 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221339 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221477 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221639 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221729 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.221976 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222062 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222280 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222365 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222579 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222667 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222891 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.222977 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223197 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223295 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223499 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223584 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223801 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.223886 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224102 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224196 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224406 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224528 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224722 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.224810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225028 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225123 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225353 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225439 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225659 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225748 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.225963 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.226059 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.226267 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.226361 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.226570 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.226664 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.227468 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.227562 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.227762 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228013 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228108 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228189 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228376 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228466 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228687 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228774 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.228997 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.229086 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.229334 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.229424 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.229644 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.229953 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230041 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230263 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230358 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230576 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230663 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230886 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.230974 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231192 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231282 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231500 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231597 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231817 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.231962 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.232145 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.232389 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.232484 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.232722 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.232808 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233036 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233121 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233362 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233450 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233662 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233749 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.233969 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.234065 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.234269 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.234363 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.234570 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.234657 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235131 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235224 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235440 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235540 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235741 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.235828 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236042 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236141 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236339 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236436 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236642 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236738 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.236954 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237049 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237279 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237384 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237582 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237670 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237882 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.237975 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238185 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238273 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238489 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238576 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238790 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.238875 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239086 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239172 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239385 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239480 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239694 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.239779 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240004 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240092 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240311 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240399 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240632 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240719 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.240939 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241027 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241275 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241380 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241577 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241677 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.241884 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242020 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242187 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242294 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242527 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242631 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242829 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.242916 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243134 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243229 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243439 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243534 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243737 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.243831 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244041 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244127 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244343 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244438 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244646 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244789 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.244949 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245043 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245269 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245373 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245574 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245872 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.245966 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246177 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246276 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246474 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246560 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246771 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.246858 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247069 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247156 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247373 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247459 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247674 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247759 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.247971 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248065 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248272 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248358 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248572 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248666 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248879 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.248973 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249200 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249291 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249502 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249601 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249799 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.249894 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250102 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250197 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250402 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250500 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250697 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250782 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.250999 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251091 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251300 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251399 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251600 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251687 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251899 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.251993 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252201 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252291 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252496 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252581 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252791 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.252876 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253093 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253232 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253428 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253524 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253736 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.253822 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254033 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254127 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254334 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254419 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254627 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254748 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.254942 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255032 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255207 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255294 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255506 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255601 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255802 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.255897 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256099 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256213 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256397 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256505 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256692 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256779 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.256989 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257077 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257314 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257411 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257616 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257704 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.257911 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258025 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258236 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258332 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258538 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258657 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258874 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.258958 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259160 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259307 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259467 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259554 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259788 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.259874 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260096 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260185 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260397 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260483 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260700 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.260798 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261002 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261089 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261337 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261426 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261639 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261726 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.261950 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262045 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262253 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262340 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262559 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262654 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262856 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.262944 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263154 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263240 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263564 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263772 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.263867 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264072 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264159 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264383 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264477 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264693 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.264787 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265004 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265094 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265323 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265424 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265625 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265712 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.265927 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266020 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266229 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266326 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266535 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266643 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266837 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.266924 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267141 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267229 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267445 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267531 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267749 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.267843 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268051 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268139 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268357 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268449 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268653 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268739 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.268958 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269044 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269279 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269379 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269579 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269666 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269886 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.269973 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270186 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270271 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270483 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270579 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270786 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.270875 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271083 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271184 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271386 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271485 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271682 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271774 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.271982 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272181 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272306 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272526 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272616 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272882 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.272970 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.273217 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.273317 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.273520 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.274143 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.274368 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.274456 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.274736 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.274835 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275050 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275183 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275350 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275498 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275762 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.275858 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276071 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276159 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276377 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276465 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276684 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276797 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.276982 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277070 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277302 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277391 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277606 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277704 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.277924 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278011 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278224 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278310 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278521 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278617 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278824 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.278911 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279140 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279232 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279436 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279523 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279749 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.279843 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280079 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280172 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280380 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280683 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280770 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.280985 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281189 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281330 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281460 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281631 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281766 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.281951 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282082 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282363 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282491 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282767 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.282975 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283072 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283283 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283377 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283585 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283672 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283899 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.283987 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284214 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284309 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284517 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284616 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284826 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.284913 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285126 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285286 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285462 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285551 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285778 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.285865 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286085 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286181 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286400 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286487 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.286831 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287035 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287135 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287338 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287438 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287659 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287747 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.287978 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288066 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288289 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288375 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288585 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288680 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.288895 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.289004 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.289239 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.289980 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290071 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290307 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290507 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290633 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290816 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.290960 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291122 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291266 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291428 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291566 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291734 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.291868 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292074 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292175 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292394 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292482 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292732 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.292829 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293030 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293149 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293370 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293458 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293678 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293777 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.293983 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294078 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294284 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294381 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294584 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294672 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294898 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.294994 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295195 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295281 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295492 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295586 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295790 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.295879 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296087 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296173 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296419 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296505 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296716 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.296817 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297030 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297158 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297359 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297446 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297662 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297751 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.297963 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298051 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298263 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298363 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298597 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298682 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298898 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.298984 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299209 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299308 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299520 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299607 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299839 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.299926 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300140 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300239 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300439 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300527 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300742 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.300829 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301040 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301159 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301362 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301458 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301660 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301759 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.301962 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302053 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302261 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302355 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302557 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302651 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302854 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.302943 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303171 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303258 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303562 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303768 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.303854 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304072 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304175 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304368 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304471 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304664 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.304751 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305007 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305104 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305351 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305527 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305655 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305828 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.305976 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306151 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306285 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306458 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306587 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306779 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.306888 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307096 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307409 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307519 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307720 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.307815 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308029 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308125 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308337 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308424 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308648 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308735 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.308963 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309122 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309293 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309380 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309605 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309692 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.309916 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310014 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310228 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310315 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310562 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310737 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.310875 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311062 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311186 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311369 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311504 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311675 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311820 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.311982 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312138 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312289 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312593 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312680 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312898 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.312995 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313225 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313317 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313530 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313617 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313835 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.313931 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314156 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314244 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314473 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314560 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314782 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.314870 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315091 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315180 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315399 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315544 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315706 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.315793 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316013 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316109 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316323 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316419 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316643 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316729 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.316969 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317061 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317297 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317397 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317606 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317694 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.317918 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318007 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318228 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318324 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318533 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318620 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318841 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.318937 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319148 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319236 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319453 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319540 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319756 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.319853 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320059 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320156 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320364 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320469 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320690 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.320786 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321007 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321094 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321358 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321448 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321676 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321763 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.321983 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322070 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322291 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322380 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322599 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322695 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.322919 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323154 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323464 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323561 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323793 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.323884 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324113 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324201 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324432 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324532 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324741 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.324948 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325035 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325285 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325389 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325622 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325757 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.325947 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326036 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326251 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326346 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326556 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326644 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326855 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.326941 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327174 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327269 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327477 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327573 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327774 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.327861 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328080 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328179 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328383 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328470 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328681 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.328913 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329008 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329283 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329386 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329594 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329681 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.329912 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330009 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330216 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330302 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330531 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330744 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.330831 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331091 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331180 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331404 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331491 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331715 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.331809 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332025 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332112 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332329 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332416 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332630 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332731 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.332948 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333087 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333281 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333383 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333586 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333687 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333891 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.333978 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334197 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334283 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334501 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334597 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334804 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.334892 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335115 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335202 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335413 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335500 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335713 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.335846 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.336015 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.336767 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.336872 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.336951 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337185 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337350 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337497 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337589 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337801 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.337892 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338105 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338194 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338495 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338709 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.338798 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339010 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339105 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339309 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339410 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339611 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339699 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.339920 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340008 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340224 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340320 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340533 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340620 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340836 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.340931 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341164 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341272 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341516 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341603 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341821 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.341907 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342124 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342229 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342428 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342515 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342734 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.342821 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343035 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343168 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343346 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343434 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343654 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343888 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.343985 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344221 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344311 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344539 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344627 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344869 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.344965 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.345216 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.345310 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.345523 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.345749 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.345838 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346081 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346173 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346399 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346487 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346721 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.346823 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347031 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347120 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347338 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347438 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347646 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347754 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.347945 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348032 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348249 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348342 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348553 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348651 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348862 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.348948 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349185 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349290 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349491 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349589 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349794 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.349882 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350097 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350185 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350401 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350489 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350700 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.350786 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351003 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351096 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351307 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351396 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351614 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.351721 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.352546 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.352643 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.352854 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.352942 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353180 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353285 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353494 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353589 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353802 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.353891 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354107 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354203 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354411 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354507 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354719 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.354815 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355031 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355125 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355336 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355433 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355635 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355725 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.355939 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356246 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356344 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356556 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356652 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356882 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.356972 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.357213 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.357322 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.357522 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.357610 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.357837 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358156 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358462 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358551 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358776 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.358863 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359085 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359190 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359409 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359498 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359732 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.359818 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.360314 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.360409 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.360624 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.360713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.360923 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361010 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361250 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361357 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361640 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361856 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.361952 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362167 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362256 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362470 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362557 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362769 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.362857 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363067 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363156 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363369 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363464 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363667 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363756 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.363965 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364054 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364262 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364349 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364559 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364653 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364858 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.364946 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365173 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365287 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365479 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365588 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365779 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.365870 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366079 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366171 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366375 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366481 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366675 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366764 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.366977 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367065 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367274 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367406 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367608 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367700 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.367907 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368010 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368212 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368385 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368509 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368599 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368816 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.368905 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369115 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369245 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369440 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369528 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369741 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.369828 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370043 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370132 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370344 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370432 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370720 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.370813 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371000 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371088 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371309 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371396 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371616 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371703 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.371920 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372008 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372235 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372320 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372539 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372641 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372842 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.372930 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373174 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373278 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373474 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373575 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373777 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.373864 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374077 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374165 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374398 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374494 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374707 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.374794 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375005 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375099 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375313 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375400 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375708 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.375935 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376030 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376244 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376334 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376547 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376641 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376868 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.376956 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377195 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377285 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377502 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377589 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377806 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.377905 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378109 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378200 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378410 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378498 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378723 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.378824 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379025 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379114 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379326 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379458 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379631 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379727 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.379937 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380023 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380241 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380327 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380551 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380684 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380852 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.380938 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381180 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381282 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381497 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381586 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381831 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.381937 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382124 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382211 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382445 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382533 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382752 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.382839 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383100 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383232 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383404 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383492 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383705 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383866 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.383960 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:14:01.384181 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.384528 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.384857 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.385209 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.385524 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.385829 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:01.386072 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:14:01.537459 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Registered counter for database nova_api Sep 28 12:14:01.541601 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Registered counter for database nova_api Sep 28 12:14:01.559227 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.561781 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.566037 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.568214 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.622212 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.context [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a(cell1) {{(pid=105399) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:14:01.624782 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.context [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a(cell1) {{(pid=105398) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:14:01.626056 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:01.626529 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:01.628051 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:01.628624 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:01.628769 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:01.629092 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:01.629219 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:01.630671 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:01.631164 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:01.631389 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:01.631834 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:01.633656 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Registered counter for database nova_cell0 Sep 28 12:14:01.634609 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:01.636572 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Registered counter for database nova_cell0 Sep 28 12:14:01.637719 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Registered counter for database nova_cell1 Sep 28 12:14:01.640499 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Registered counter for database nova_cell1 Sep 28 12:14:01.645296 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.646936 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.650955 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.653232 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.654829 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.656318 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.658141 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.660876 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.801809 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Registered counter for database nova_cell0 Sep 28 12:14:01.802962 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Registered counter for database nova_cell0 Sep 28 12:14:01.811402 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.815002 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:01.816218 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:01.819679 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:02.152292 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:02.155741 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:02.159520 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:02.163016 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:02.500519 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:02.506476 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:02.507667 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:02.512865 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caaa65f9c0 pid: 105399 (default app) Sep 28 12:14:02.513629 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-27677d93-ce07-4670-8bcf-7eb7380d0fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:02.514932 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:14:02.516116 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Sep 28 12:14:02.516529 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Sep 28 12:14:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:14:02.518869 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caaa65f9c0 pid: 105398 (default app) Sep 28 12:15:23.891917 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.894206 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002737 Sep 28 12:15:23.895243 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:23.914185 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:23.915098 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell1:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:23.916129 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell0:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:23.916891 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:24.806152 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-b6005c0b-686c-4e6b-bfc0-2de68347edb0 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:24.841274 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-b6005c0b-686c-4e6b-bfc0-2de68347edb0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938760 Sep 28 12:15:24.842278 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:27.503604 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.504656 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f6557bc3-d37e-482c-a9b8-d918f4d20391 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 28 12:15:27.505281 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:27.968469 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-fdc1aacf-aefe-4ea4-b50b-8c29da10c397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:28.016800 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-fdc1aacf-aefe-4ea4-b50b-8c29da10c397 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504910 Sep 28 12:15:28.017425 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:15:28.031838 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.032962 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell1:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.034882 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.035631 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.251815 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-595fb9b7-c68e-4cf5-9a5f-01cc96349419 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:28.324941 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-595fb9b7-c68e-4cf5-9a5f-01cc96349419 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298352 Sep 28 12:15:28.325634 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 12:15:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:30.963499 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-fdc1aacf-aefe-4ea4-b50b-8c29da10c397 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.965245 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-fdc1aacf-aefe-4ea4-b50b-8c29da10c397 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 Sep 28 12:15:30.965667 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:31.637151 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-fabf3212-3ab7-4aed-8e44-da904b591d4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "id": "d1", "swap": 0, "ram": 512}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:31.677693 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-fabf3212-3ab7-4aed-8e44-da904b591d4b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705597 Sep 28 12:15:31.681249 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:31.690908 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-c988cd88-2585-4f5e-8e80-0b8021413907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:31.732870 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-c988cd88-2585-4f5e-8e80-0b8021413907 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045799 Sep 28 12:15:31.733645 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 12:15:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:34.374699 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-fabf3212-3ab7-4aed-8e44-da904b591d4b admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.375647 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-fabf3212-3ab7-4aed-8e44-da904b591d4b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 28 12:15:34.376046 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:34.799781 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-6a05ad7a-275e-4198-a17e-a51513cc3fd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:34.820629 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-6a05ad7a-275e-4198-a17e-a51513cc3fd0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436879 Sep 28 12:15:34.822599 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:34.834877 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b2401612-f262-46bd-8f9f-9fe00437b758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:34.864183 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b2401612-f262-46bd-8f9f-9fe00437b758 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033393 Sep 28 12:15:34.864842 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 12:15:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:37.618386 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-6a05ad7a-275e-4198-a17e-a51513cc3fd0 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:37.619396 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-6a05ad7a-275e-4198-a17e-a51513cc3fd0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 28 12:15:37.619816 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:38.049885 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-99678b7f-5fbd-4625-8fcb-9861bc0a9de3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:38.072011 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-99678b7f-5fbd-4625-8fcb-9861bc0a9de3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445945 Sep 28 12:15:38.073176 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:38.085269 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-0d5910f7-eef0-4d66-8bc4-7c7bec3149ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:38.113477 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-0d5910f7-eef0-4d66-8bc4-7c7bec3149ae admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032172 Sep 28 12:15:38.114847 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 12:15:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:40.756291 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-99678b7f-5fbd-4625-8fcb-9861bc0a9de3 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:40.757342 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-99678b7f-5fbd-4625-8fcb-9861bc0a9de3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 28 12:15:40.757742 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:41.178548 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:41.199178 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435079 Sep 28 12:15:41.199752 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:41.212863 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-ebebeece-8359-4f06-8246-03aa622b4f94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:41.238071 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-ebebeece-8359-4f06-8246-03aa622b4f94 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028875 Sep 28 12:15:41.238907 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 12:15:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:43.816132 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:43.817927 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Sep 28 12:15:43.818461 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:44.239942 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-495498f6-8933-41e9-a5a9-605166fed9af admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:44.264737 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-495498f6-8933-41e9-a5a9-605166fed9af admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440219 Sep 28 12:15:44.265233 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:47.240254 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:47.241345 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-856701a6-3e0e-4da7-9900-6c5cd5218019 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 28 12:15:47.241740 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:47.653325 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a08a6845-07df-4ce7-a980-7413b7736f4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:47.674928 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a08a6845-07df-4ce7-a980-7413b7736f4b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425619 Sep 28 12:15:47.675611 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:47.690615 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1b5468ff-c0a4-44c4-8bf2-e690c1eeef63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:47.718830 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-1b5468ff-c0a4-44c4-8bf2-e690c1eeef63 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032014 Sep 28 12:15:47.719408 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 12:15:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:50.329531 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a08a6845-07df-4ce7-a980-7413b7736f4b admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.330474 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a08a6845-07df-4ce7-a980-7413b7736f4b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 28 12:15:50.330877 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:50.732604 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-039affb5-6bae-4f63-81dc-5978a16047c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:50.751914 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-039affb5-6bae-4f63-81dc-5978a16047c0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413936 Sep 28 12:15:50.752468 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:15:50.765176 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-28e8eef8-8fe8-4c2a-b549-9b57ccbd2152 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:50.787775 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-28e8eef8-8fe8-4c2a-b549-9b57ccbd2152 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026394 Sep 28 12:15:50.788312 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 12:15:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:53.416582 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-039affb5-6bae-4f63-81dc-5978a16047c0 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:53.417914 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-039affb5-6bae-4f63-81dc-5978a16047c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Sep 28 12:15:53.418309 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:53.823940 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-36ef32ea-77b1-4419-a358-2afc4b7caa93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "id": "3", "vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:53.869979 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-36ef32ea-77b1-4419-a358-2afc4b7caa93 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445308 Sep 28 12:15:53.871353 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:15:53.883512 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-77f170e6-5d6f-4580-abc1-a756d7a4414a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:53.909820 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-77f170e6-5d6f-4580-abc1-a756d7a4414a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030619 Sep 28 12:15:53.925168 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 12:15:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:56.572709 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-36ef32ea-77b1-4419-a358-2afc4b7caa93 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.573774 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-36ef32ea-77b1-4419-a358-2afc4b7caa93 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 28 12:15:56.574374 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:57.044351 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-5b7b88a7-43a6-4d14-8570-65ec8c1bd228 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "ram": 8192}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:57.064367 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.091301 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-5b7b88a7-43a6-4d14-8570-65ec8c1bd228 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510872 Sep 28 12:15:57.092018 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:15:57.108359 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-ea4d947b-81f7-4c8c-a398-94427562857f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:57.139688 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-ea4d947b-81f7-4c8c-a398-94427562857f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037743 Sep 28 12:15:57.140549 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 12:15:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:59.772622 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-5b7b88a7-43a6-4d14-8570-65ec8c1bd228 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:59.774291 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-5b7b88a7-43a6-4d14-8570-65ec8c1bd228 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Sep 28 12:15:59.774694 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:00.221748 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "id": "5", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:00.231397 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:00.243587 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462787 Sep 28 12:16:00.244241 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 12:15:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:00.261384 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-d5925940-a825-4178-bb99-d6c37d547cd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:00.289103 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-d5925940-a825-4178-bb99-d6c37d547cd2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031299 Sep 28 12:16:00.290040 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 12:16:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:19.702752 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:19.703773 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 28 12:16:19.704180 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:19.715390 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:20.096135 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-2cd6bd4d-5b39-4200-a26b-232f218670df admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:20.114975 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-2cd6bd4d-5b39-4200-a26b-232f218670df admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403955 Sep 28 12:16:20.115502 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 12:16:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:21.430339 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.431376 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a85bf857-3d2d-4bb6-b98f-34b249ecdf89 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 28 12:16:21.431776 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:21.952866 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-299bbc67-aa66-422a-a191-b7e4c8f62375 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.958849 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-299bbc67-aa66-422a-a191-b7e4c8f62375 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-299bbc67-aa66-422a-a191-b7e4c8f62375 admin admin] Request method failure captured: Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Host: 10.222.0.60 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjNDsViikCQ-Ya88X9HNawF9XFU_xWUOcDhxaqWql_5R4zr2yUeBv5-Pon8cJp-4GkYidWg5AycgO3BHipJZylB_Q-wGYCC7dbfAPphJclVgcZlR98qqJqVxXBA0myjVbk0fZelXk9Se32XNongUj-ZZQq9k-LbCEs2Uh9ynNwgU-Z8Qc Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Role: admin,member,reader Sep 28 12:16:21.962076 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Roles: admin,member,reader Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User: admin Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: method: > Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: exception: Flavor 42 could not be found. Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: action_args: {'id': '42'} Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:21.963758 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:21.964810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:21.966146 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-299bbc67-aa66-422a-a191-b7e4c8f62375 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:21.967389 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-299bbc67-aa66-422a-a191-b7e4c8f62375 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393162 Sep 28 12:16:21.967389 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:21.973714 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-9dccd9a4-9f7d-4027-8b66-29571fc1a406 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.996544 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-9dccd9a4-9f7d-4027-8b66-29571fc1a406 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026706 Sep 28 12:16:21.997075 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:22.008044 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-f1122a6e-ad55-4886-b04d-e49b43d152b7 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:22.029876 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-f1122a6e-ad55-4886-b04d-e49b43d152b7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026156 Sep 28 12:16:22.030411 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:22.040103 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-82f63a08-b876-4259-8ea4-0a20396ccf9e admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:22.045266 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-82f63a08-b876-4259-8ea4-0a20396ccf9e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-82f63a08-b876-4259-8ea4-0a20396ccf9e admin admin] Request method failure captured: Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Host: 10.222.0.60 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjNDsViikCQ-Ya88X9HNawF9XFU_xWUOcDhxaqWql_5R4zr2yUeBv5-Pon8cJp-4GkYidWg5AycgO3BHipJZylB_Q-wGYCC7dbfAPphJclVgcZlR98qqJqVxXBA0myjVbk0fZelXk9Se32XNongUj-ZZQq9k-LbCEs2Uh9ynNwgU-Z8Qc Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Role: admin,member,reader Sep 28 12:16:22.048488 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Roles: admin,member,reader Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User: admin Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: method: > Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: exception: Flavor 42 could not be found. Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: action_args: {'id': '42'} Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:22.050713 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:22.051552 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:22.052583 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-82f63a08-b876-4259-8ea4-0a20396ccf9e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:22.053634 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-82f63a08-b876-4259-8ea4-0a20396ccf9e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014228 Sep 28 12:16:22.053634 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 12:16:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:23.288335 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-f1122a6e-ad55-4886-b04d-e49b43d152b7 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.289383 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-f1122a6e-ad55-4886-b04d-e49b43d152b7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 28 12:16:23.289807 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:23.817723 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-9b3794ab-4075-4648-b4e2-0cf5739e5a73 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.822681 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-9b3794ab-4075-4648-b4e2-0cf5739e5a73 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-9b3794ab-4075-4648-b4e2-0cf5739e5a73 admin admin] Request method failure captured: Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Host: 10.222.0.60 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjNDsXNjD6hNRyiejIcmsFKy8OS9QeMhuv25CNsueZsNdoB9VCxEK_dR5EjJZx6-dpRF6_jU8yfE3FXvchegIyY_NIVnhN-gLnbB7hvwWQCu_6PwT__gPffNxEhB1qJH-RMZF68kMS2rCeurqBqWcFYuxITNuIEW-O_x9Lm9OHY0yev0I Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Role: admin,member,reader Sep 28 12:16:23.824169 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Roles: admin,member,reader Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User: admin Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: method: > Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: exception: Flavor 84 could not be found. Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: action_args: {'id': '84'} Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:23.825619 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.826408 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.827429 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-9b3794ab-4075-4648-b4e2-0cf5739e5a73 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:23.828674 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-9b3794ab-4075-4648-b4e2-0cf5739e5a73 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397461 Sep 28 12:16:23.828674 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:23.836055 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-450b0368-9022-49e0-a465-9cec0080923e admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.850715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-450b0368-9022-49e0-a465-9cec0080923e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018135 Sep 28 12:16:23.851174 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:23.860656 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f39bedd8-e5d9-41d6-8808-f595d03b227e admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.876385 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f39bedd8-e5d9-41d6-8808-f595d03b227e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019527 Sep 28 12:16:23.877522 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:23.886383 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-e4e0c008-f8de-4096-9db7-07b63009f8ea admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.891224 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-e4e0c008-f8de-4096-9db7-07b63009f8ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-e4e0c008-f8de-4096-9db7-07b63009f8ea admin admin] Request method failure captured: Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Host: 10.222.0.60 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjNDsXNjD6hNRyiejIcmsFKy8OS9QeMhuv25CNsueZsNdoB9VCxEK_dR5EjJZx6-dpRF6_jU8yfE3FXvchegIyY_NIVnhN-gLnbB7hvwWQCu_6PwT__gPffNxEhB1qJH-RMZF68kMS2rCeurqBqWcFYuxITNuIEW-O_x9Lm9OHY0yev0I Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Role: admin,member,reader Sep 28 12:16:23.892715 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Roles: admin,member,reader Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User: admin Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: method: > Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: exception: Flavor 84 could not be found. Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: action_args: {'id': '84'} Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:23.894283 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.895242 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.896674 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-e4e0c008-f8de-4096-9db7-07b63009f8ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:23.897916 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-e4e0c008-f8de-4096-9db7-07b63009f8ea admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011122 Sep 28 12:16:23.897916 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:25.122005 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f39bedd8-e5d9-41d6-8808-f595d03b227e admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.123036 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f39bedd8-e5d9-41d6-8808-f595d03b227e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 28 12:16:25.123426 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:25.644010 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1ad5d6e7-ea0f-457f-94a4-e16071de1f31 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.649752 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-1ad5d6e7-ea0f-457f-94a4-e16071de1f31 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1ad5d6e7-ea0f-457f-94a4-e16071de1f31 admin admin] Request method failure captured: Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Host: 10.222.0.60 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjNDsZcdep3ZyhXxmt6jrArw2ABPaU5q9udfeO5rx-X-PdbhiVsi8c4qMBtOMVWGdDTNqSDVO3rM7aZPi3DieVHMqb3h484VYjiEVQ_n3Cyqocnk7A2jBqSv8MiKBDZPH1m4iKlJF3H2CiAoEMf6TwwAbuJmATju3aLZiLUZvYs_mhyuI Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Role: admin,member,reader Sep 28 12:16:25.651230 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Roles: admin,member,reader Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User: admin Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: method: > Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: exception: Flavor 451 could not be found. Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: action_args: {'id': '451'} Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:25.652839 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.653810 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.654925 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1ad5d6e7-ea0f-457f-94a4-e16071de1f31 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:25.656009 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-1ad5d6e7-ea0f-457f-94a4-e16071de1f31 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388783 Sep 28 12:16:25.656009 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:25.663146 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-75b4cb4d-10a3-4964-942e-4d707a830cc5 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.678383 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-75b4cb4d-10a3-4964-942e-4d707a830cc5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018885 Sep 28 12:16:25.678894 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:25.688079 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.702663 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018052 Sep 28 12:16:25.703180 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:25.712351 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b1529880-75cd-459a-a4ad-40e752594bd3 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.717298 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-b1529880-75cd-459a-a4ad-40e752594bd3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b1529880-75cd-459a-a4ad-40e752594bd3 admin admin] Request method failure captured: Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Host: 10.222.0.60 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjNDsZcdep3ZyhXxmt6jrArw2ABPaU5q9udfeO5rx-X-PdbhiVsi8c4qMBtOMVWGdDTNqSDVO3rM7aZPi3DieVHMqb3h484VYjiEVQ_n3Cyqocnk7A2jBqSv8MiKBDZPH1m4iKlJF3H2CiAoEMf6TwwAbuJmATju3aLZiLUZvYs_mhyuI Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Role: admin,member,reader Sep 28 12:16:25.718785 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Roles: admin,member,reader Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fc00be567cf4966a588e131d48e5a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fc00be567cf4966a588e131d48e5a69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fc00be567cf4966a588e131d48e5a69"}]}] Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 2fc00be567cf4966a588e131d48e5a69 Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User: admin Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Id: 1290a1aa40a149388a72943a7b2dc68e Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: method: > Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: exception: Flavor 451 could not be found. Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: action_args: {'id': '451'} Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:25.720335 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.722115 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.723468 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b1529880-75cd-459a-a4ad-40e752594bd3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:25.724835 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b1529880-75cd-459a-a4ad-40e752594bd3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011286 Sep 28 12:16:25.724835 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:26.927486 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:26.928482 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 28 12:16:26.928869 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:27.450545 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-279a6395-1ed7-4a4c-b509-af46d110fdd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:27.469596 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-279a6395-1ed7-4a4c-b509-af46d110fdd6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405151 Sep 28 12:16:27.470144 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 12:16:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:28.691900 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:28.692979 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 28 12:16:28.693412 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:29.214419 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-2418e136-6a30-498d-b612-03b2b23faf7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:29.232444 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-2418e136-6a30-498d-b612-03b2b23faf7a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401721 Sep 28 12:16:29.233262 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 12:16:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:30.492773 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:30.493870 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 28 12:16:30.494261 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:31.017730 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-16eb7635-747e-484c-ac22-3df2b9418185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:31.036532 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-16eb7635-747e-484c-ac22-3df2b9418185 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402563 Sep 28 12:16:31.037072 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 12:16:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:32.262644 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:32.263653 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 28 12:16:32.264045 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:32.786155 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-5da7052f-865b-44e6-bf17-55471881402d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:32.804823 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-5da7052f-865b-44e6-bf17-55471881402d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401902 Sep 28 12:16:32.805400 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 12:16:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:34.025185 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:34.026189 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 28 12:16:34.026585 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:34.547841 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-ebb8a86e-8279-4a09-a980-f83e47c7caa9 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:34.568477 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-ebb8a86e-8279-4a09-a980-f83e47c7caa9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403780 Sep 28 12:16:34.569116 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 28 12:16:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:17:31.835336 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:31.836522 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-8b2ea646-f43e-4927-8867-e0304f1ff0bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Sep 28 12:17:31.837042 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 12:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:17:31.847546 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:32.227200 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-142f9590-64d2-4505-9898-bd71477e9c24 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.249033 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-142f9590-64d2-4505-9898-bd71477e9c24 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405888 Sep 28 12:17:32.249603 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 12:17:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:17:32.270400 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=14 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:32.274111 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-473669d2-2c00-4b65-8ff4-31454edec191 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.282022 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-473669d2-2c00-4b65-8ff4-31454edec191 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013167 Sep 28 12:17:32.282533 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:32.294064 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-851ef4e1-d4bb-48d2-a8a1-e4ecfb697782 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.302229 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-851ef4e1-d4bb-48d2-a8a1-e4ecfb697782 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011709 Sep 28 12:17:32.302750 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:32.314307 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.321464 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010847 Sep 28 12:17:32.321970 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:32.333159 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-9ac8f33f-e713-4d6e-bdbe-18e82b47ffec admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.340136 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-9ac8f33f-e713-4d6e-bdbe-18e82b47ffec admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010374 Sep 28 12:17:32.340640 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:20:43.021694 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:43.022713 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 28 12:20:43.023113 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:20:43.175143 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=6 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:43.374990 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:43.379839 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:43.380309 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:43.380735 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:43.381599 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:43.382047 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:43.382460 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:43.415214 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-f83fb23c-3d41-40db-8e0a-d1db4bbd9d1d admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.241824 Sep 28 12:20:43.415778 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:20:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:20:44.506838 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:44.507889 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 28 12:20:44.508333 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:20:44.699964 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:44.703370 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:44.703845 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:44.704274 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:44.704984 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:44.705457 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:44.705878 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:44.725286 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-575c8568-cd07-4084-823f-81b01e76dc0d admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077065 Sep 28 12:20:44.725727 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:20:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:20:56.241054 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:56.242077 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 28 12:20:56.242465 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:20:56.388315 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=4 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:56.389047 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell1:SELECT=4 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:56.389695 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=8 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:56.438561 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:56.442646 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:56.443125 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:56.443559 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:56.444275 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:56.444727 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:56.445167 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:56.470417 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-4218b4e5-b957-41e2-9c5e-9bc3725eb115 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087140 Sep 28 12:20:56.470963 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:20:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:20:57.548788 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:57.549808 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-424c4eff-c745-481b-996b-e89ed52ab83d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 28 12:20:57.550201 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 12:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:20:57.741543 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:20:57.745557 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:57.746027 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:57.746452 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:57.747154 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:20:57.747611 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:20:57.748006 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:20:57.769121 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b6531501-25c5-4dc0-bcb0-c6462c731618 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078143 Sep 28 12:20:57.769626 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 12:20:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:21:55.323463 dv-cinder-844563-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 12:21:55.323990 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: Wed Sep 28 12:21:55 2022 - graceful shutdown triggered... Sep 28 12:21:55.324464 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: Gracefully killing worker 1 (pid: 105398)... Sep 28 12:21:55.324947 dv-cinder-844563-9-iscsi devstack@n-api.service[105399]: Gracefully killing worker 2 (pid: 105399)... Sep 28 12:21:55.450856 dv-cinder-844563-9-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=4 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:56.325000 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: worker 1 buried after 1 seconds Sep 28 12:21:56.325000 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: worker 2 buried after 1 seconds Sep 28 12:21:56.325000 dv-cinder-844563-9-iscsi devstack@n-api.service[105397]: goodbye to uWSGI. Sep 28 12:21:56.326562 dv-cinder-844563-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 12:21:56.327105 dv-cinder-844563-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 12:21:56.329920 dv-cinder-844563-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 12:21:56.340257 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:21:56 2022] *** Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: nodename: dv-cinder-844563-9-iscsi Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: machine: x86_64 Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: clock source: unix Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: pcre jit disabled Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: detected number of CPU cores: 4 Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: current working directory: / Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:21:56.342439 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: your processes number limit is 47680 Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: your memory page size is 4096 bytes Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: detected max file descriptor number: 2048 Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: lock engine: pthread robust mutexes Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: thunder lock: enabled Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 12:21:56.343166 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:21:56.388817 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: Python main interpreter initialized at 0x56553e7039c0 Sep 28 12:21:56.388817 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: python threads support enabled Sep 28 12:21:56.388817 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: your server socket listen backlog is limited to 100 connections Sep 28 12:21:56.388817 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:21:56.389279 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:21:56.389279 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: *** Operational MODE: preforking *** Sep 28 12:21:56.389540 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:21:56.389540 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: spawned uWSGI master process (pid: 120379) Sep 28 12:21:56.389791 dv-cinder-844563-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 12:21:56.391666 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: spawned uWSGI worker 1 (pid: 120392, cores: 1) Sep 28 12:21:56.391666 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: spawned uWSGI worker 2 (pid: 120393, cores: 1) Sep 28 12:21:56.391666 dv-cinder-844563-9-iscsi devstack@n-api.service[120379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:21:57.052938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:21:57.080943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:21:58.216460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:21:58.216460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: from cryptography.utils import int_from_bytes Sep 28 12:21:58.217070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:21:58.217070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: from cryptography.utils import int_from_bytes Sep 28 12:21:58.308333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:21:58.308333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: from cryptography.utils import int_from_bytes Sep 28 12:21:58.308927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:21:58.308927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: from cryptography.utils import int_from_bytes Sep 28 12:22:00.681193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:22:00.681759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:22:00.682078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:22:00.682447 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:22:00.682705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:22:00.683095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.683423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.683743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.684063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.684395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.684705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.685025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.685369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.685698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.685957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.686276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.686739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-9-iscsi {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.687067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.687379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.687694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.688014 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.688319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.688641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.688968 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.689487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.690935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.690935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.690935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.690935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.691282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.691498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.691758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.692085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.692386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.692688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.693083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-9-iscsi {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.693445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.693761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.694070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.694474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.694784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.695101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.698761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.699065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.699368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.699600 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.699909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.700233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.700555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.700873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.701123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.701393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.701710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.702028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.702337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.702643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.702948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.703253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.703557 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.703857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.704161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.704472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.704785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.705097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.705443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.705752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.706067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.706462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.706711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.707016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.707357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.707673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.707980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.708882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.708882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.708882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.709388 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.709539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.710468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.710468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.710468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.710990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.710990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.711391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.711553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.711872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.712174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.712479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.712787 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.713078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.713409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.713713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.714015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.714321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.714659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.714967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.715289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.715596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.715902 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.716257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.716577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.716883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.717251 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.717560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.717910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.718232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.718539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.720915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.722295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.722295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.722295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.722295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.722295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.723280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.723280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.723632 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.723826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.724173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.724481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.725028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.725430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.725754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.726094 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.726405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.727257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.727558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.727884 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.728223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.728554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.728897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.729234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.729570 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.729903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.730222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.730536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.730849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.731175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.731484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.731796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.732107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.732425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.732742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.733071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.733412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.733728 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.734045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.734363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.734688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.735004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.735344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.735643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.735985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.736330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.736645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.736968 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.737319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.737630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.737940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.738249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.738591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.738903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.739215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.739539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.739975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.740171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.740484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.740795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.741108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.741439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.741780 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.742099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.742947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.743275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.743630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.743900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.744423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.744927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.745446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.746537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.747068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.747374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.747685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.748033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.748348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.748711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.749052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.749396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.749733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.750199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.750707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.751180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.751584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.751985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.752351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.752693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.753005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.753396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.753713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.754023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.754393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.754702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.755053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.755376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.755692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.756004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.756318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.756630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.757018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.757358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.757740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.758095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.758465 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.758774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.759101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.759473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.760027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.760349 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.760639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.760976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.761475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.761794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.762112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.762432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.762729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.763039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.763344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.763865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.764334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.764656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.764965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.765297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.765607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.765963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.766271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.766619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.766959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.767282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.767607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.767923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.768241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.768552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.768865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.769287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.769524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.769847 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.770173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.770489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.770799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.771128 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.771441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.771763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.772070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.772387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.772750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.773070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.773462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.773783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.774095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.774411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.774724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.775035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.775396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.775706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.776572 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.776572 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.776753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.776970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.777331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.777644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.778042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.778271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.778590 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.778962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.779437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.779754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.780077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.780402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.780717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.781030 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.781379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.781688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.781995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.782306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.782622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.782933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.783244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.783576 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.783912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.784247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.784557 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.784863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.785201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.785533 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.785844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.786166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.786489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.786793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.787097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.787420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.788226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.788226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.788518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.788677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.789549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.789965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.790193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.790509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.790841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.791152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.791474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.791787 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.792101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.792427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.792748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.793061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.793400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.793712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.794023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.794332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.799993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.800273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.800627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.800963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.801302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.801612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.801940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.802246 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.802637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.802944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.803287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.803593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.805748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.805748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.805748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.805748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.805748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.806227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.806401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.806716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.807069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.807381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.807775 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.808091 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.808494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.808835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.809203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.809517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.809826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.810157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.810475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.810781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.811090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.811405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.811714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.812019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.812336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.812648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.812961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.813301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.813609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.813921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.814226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.814547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.814861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.815165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.815474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.815785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.816096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.816401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.816714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.817018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.817361 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.817854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.818393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.818947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.819503 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.820050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.821185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.821767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.822326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.822877 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.823428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.823986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.824529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.825069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.825688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.826286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.826852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.827408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.827963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.828455 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.828978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.829602 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.829928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.830242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.830581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.831172 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.832174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.832488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.832827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.833153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.833489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.833800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.834107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.834462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.834770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.835136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.835445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.835766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.836682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.837007 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.837391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.837653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.837959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.838277 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.838589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.838903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.839207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.839517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.839842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.840195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.840509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.840830 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.841334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.841532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.841838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.842195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.842505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.842815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.843162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.843473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.843827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.844141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.844478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.844840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.845175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.845542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.845860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.846176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.846480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.846809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.847124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.847491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.847800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.848106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.848459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.848766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.849291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.849609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.850220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.850527 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.850899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.851214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.851584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.851940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.852220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.852640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.852953 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.853288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.853603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.853908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.854212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.854521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.854844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.855148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.855453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.855758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.856079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.856383 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.856702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.857117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.857448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.857754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.858169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.858480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.858790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.859112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.859432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.859757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.860062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.860359 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.860673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.860996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.861340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.861649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.861969 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.862277 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.862599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.862922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.863238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.863558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.863973 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.864297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.864606 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.864929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.865298 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.865589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.865896 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.866207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.866514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.866823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.867750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.868187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.868540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.868854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.869189 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.869500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.869808 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.870132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.870440 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.870761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.871076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.871399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.871768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.872030 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.872353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.872663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.872968 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.873292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.873599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.873942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.874249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.874567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.874898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.875226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.875537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.875871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.876199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.876518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.876828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.877171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.877489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.877793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.878097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.878404 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.878707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.879011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.879313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.879621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.879922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.880227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.880529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.880848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.881166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.881491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.881871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.882107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.882410 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.882739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.883744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.884317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.884418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:22:00.884862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:22:00.884961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.884961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.885169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:22:00.885315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.885523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:22:00.885666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.885791 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:22:00.885939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.886190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.886285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.886526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.886625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.886856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.886964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.887172 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.887265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.887491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.887591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.887801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.887905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.888117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.888218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.888431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.888532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.888748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.888954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.889252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.889349 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.889579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.889685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.889911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-9-iscsi {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.890031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.890242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.890340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.890551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.890664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.890869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.890985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.891184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.891332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.891508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.891622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.891805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.891943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.892230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.892337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.892438 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.892617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.892725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.892932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.893029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.893274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.893384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.893594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.893685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.893962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.894053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.894286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.894426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.894622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.894713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.894949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.895040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.895266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.895357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.895624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.895722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.895937 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.896035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.896302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.896395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-9-iscsi {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.896619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.896717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.896932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.897038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.897311 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.897499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.897666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.897815 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.897976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.898124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.898277 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.898463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.898617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.898817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.899000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.899281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.899459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.899607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.899761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.899945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.900107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.900254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.900397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.900611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.900773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.900929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.901084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.901280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.901437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.901590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.901743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.901899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.902158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.902339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.902486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.902676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.902834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.902990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.903137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.903281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.903425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.903580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.903733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.903889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.904035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.904180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.904325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.904475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.904629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.904778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.904930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.905085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.905310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.905460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.905616 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.905764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.905915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.906060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.906218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.906372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.906518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.906670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.906823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.906976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.907121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.907290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.907446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.907598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.907744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.907888 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.908031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.908210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.908372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.908520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.908665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.908845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.908997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.909176 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.909351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.909500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.909645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.909821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.909982 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.910136 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.910281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.910435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.910581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.910725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.910881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.911035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.911191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.911336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.911482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.911633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.911792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.911937 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.912090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.912261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.912419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.912565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.912762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.912918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.913063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.913254 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.913402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.913560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.913707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.913859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.914062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.914245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.914458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.914627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.914627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.914905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.915059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.915205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.915361 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.915516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.915663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.915806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.915950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.916110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.916259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.916412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.916558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.916711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.916864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.917009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.917190 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.917353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.917506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.917661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.917816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.917962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.918124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.918277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.918422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.918566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.918718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.918865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.919019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.919175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.919329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.919474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.919618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.919762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.919990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.920147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.920293 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.920445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.920591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.920753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.920901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.921053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.921259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.921424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.921571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.921716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.921868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.922021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.922021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.922313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.922466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.922619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.922764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.922908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.923062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.923261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.923420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.923575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.923721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.923874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.924029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.924184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.924329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.924482 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.924627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.924772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.924931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.925078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.925263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.925362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.925450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.925554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.925642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.925781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.925957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.926087 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.926267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.926446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.926579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.926674 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.926887 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.926977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.927198 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.927299 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.927507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.927613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.927819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.927949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.928120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.928213 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.928436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.928542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.928741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.928839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.929052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.929166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.929389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.929480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.930315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.930435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.930606 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.930865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:22:00.931020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.931267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.931436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.931595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.931750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.931897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.932888 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.933854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934620 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.934956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.935994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936623 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.936928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.937918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.938858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939006 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939315 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.939943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.940885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941198 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.941981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.942887 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943489 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.943990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944304 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.944905 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.945061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.945316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.945975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.946868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947211 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.947981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948320 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.948963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949115 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.949987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.950951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951409 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.951996 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952198 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952649 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.952961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953594 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953777 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.953943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.954918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955673 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.955981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956650 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.956942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957465 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.957952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958742 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.958913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.959846 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.960863 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.961022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.961213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.961380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.961762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.961921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.962101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.962269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.962423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.962592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.962745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:22:00.962898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.963050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.963317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.963630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.963943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.964276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.964593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.964904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.965241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.965553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.965912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.966225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.966573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.966912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.967238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.967567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.967885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.968207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.968524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.968840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.969175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.969498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.969825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.970143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.970468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.970784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.971112 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.971428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.971755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.972065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.972386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.972733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.973073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.973422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.973750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.974069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.974392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.974710 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.975293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.975612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.975934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.976263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.976673 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.977294 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.977625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.977960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.978278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.978607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.978918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.979240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.979576 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.979918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.980235 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.980553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.980881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.981283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.981606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.981924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.982237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.982549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.982864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.983188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.983504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.983822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.984133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.984454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.984897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.985075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.985398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.985720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.986049 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.986365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.986692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.987020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.987328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.987636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.987965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.988283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.988591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.988898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.989239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.989593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.989908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.990220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.990540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.990866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.991183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.991506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.991821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.992670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.993302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.993697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.994021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.994342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.994661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.994983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.995305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.995637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.995955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.996281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.996599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.996908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.997253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.997584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.998164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.998507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.998839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.999176 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.999538 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:00.999889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.000231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.000567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.000913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.001251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.001604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.001921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.002234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.002552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.002865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.003177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.003579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.003830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.004162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.004479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.004791 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.005162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.005475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.005785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.006131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.006449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.006782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.007100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.007412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.008307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.008860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.009394 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.009715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.010096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.010442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.010797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.011115 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.011432 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.011766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.012136 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.012397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.012710 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.013029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.013383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.013699 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.014019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.014336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.014655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.014972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.015283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.015604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.015916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.016243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.016561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.016874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.017209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.017529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.017844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.018155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.018470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.018781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.019101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.019412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.019728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.020040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.020359 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.020674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.020984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.021340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.021660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.021972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.022282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.022600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.022911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.023224 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.023748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.024297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.024629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.024945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.025291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.025526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO dbcounter [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Registered counter for database nova_api Sep 28 12:22:01.025629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.025909 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.026225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.026545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.026855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.027169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.027703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.028021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.028337 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.028672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.028992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.029331 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.029647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.029960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.030310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.030624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.030995 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.031309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.031636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.031967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.032287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.032607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.032930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.033270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.033587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.033908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.034229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.034540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.034851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.035181 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.035500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.035816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.036144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.036479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.036811 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.037118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.037458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.037776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.038092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.038408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.038730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.039080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.039680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.040081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.041206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.041206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.041206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.041457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.042065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.042065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.042304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.042612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.042922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.043239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.043550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.044052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.044199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.044924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.044924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.045265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.045620 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.045912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.046236 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.046562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.046918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.047253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.047798 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.048073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_db.sqlalchemy.engines [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.048184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.048440 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.048762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.049101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.049437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.049781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.050166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.050443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.051099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.051416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.051748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.052061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.052421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.052851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.053216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.053534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.053989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.054307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.055193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.055656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.056157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writer thread running {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.056266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.056643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.057069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.057351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.057675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.058011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.058343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.058664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.058990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.059303 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.059635 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.059967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.060292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.060622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.061048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.061410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.061729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.062060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.062397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.062712 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.063024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.063345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.063674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.063975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.064307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.064619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.064938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.065288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.065609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.065920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.066232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.066559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.066879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.067207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.067526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.067853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.068180 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.068489 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.068817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.069147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.069468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.069780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.070123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.071162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.071623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.071957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.072297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.072639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.072960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.073332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.073669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.074022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.074312 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.074640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.074973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.075283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.075656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.075906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.076216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.076526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.076842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.077174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.077483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.077792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.078102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.078432 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.078742 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.079070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.079494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.079689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.079996 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.080303 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.080653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.080964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.081329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.081667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.081999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.082324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.082645 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.082967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.083288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.083609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.083932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.084257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.084574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.084896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.085258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.085587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.086409 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.086801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.087129 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.087454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.087780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.088105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.088428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.088750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.089070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.089420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.089740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.090076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.090405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.090739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.091084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.091414 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.091741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.092063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.092386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.092752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.093070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.093412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.093735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.094058 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.094381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.094728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.095069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.095421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.095773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.096093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.096470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.096823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.097190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.097547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.097890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.098220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.098569 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.098894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.099220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.100008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.100361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.100702 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.101060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.101492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.101978 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.102458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.102930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.103252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.103590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.103912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.104257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.104575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.104908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.105276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.105589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.105937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.106254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.106800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.107166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.107500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.107862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.108198 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.108527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.108844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.109197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.109516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.109858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.110183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.110504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.110813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.111124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.111444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.111761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.112071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.112217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.context [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a(cell1) {{(pid=120393) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:22:01.112389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.112697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.113031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.113370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.113684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.113997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.114317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.114631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.114941 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.115250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.115560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.115949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.116167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.116315 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.116614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.116779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.116948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.117939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.118511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.118812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.118967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.119145 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.119486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.119642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.119795 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.119971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.120137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.120420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.120744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.121078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.121431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.121802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.122161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.122321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.122473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.123065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.123424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.123797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.124146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.124240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO dbcounter [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Registered counter for database nova_cell0 Sep 28 12:22:01.124489 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.124808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.125124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.125466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.125800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.126119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.126445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.126764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.127080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.127403 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.127721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.128038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.128265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO dbcounter [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Registered counter for database nova_cell1 Sep 28 12:22:01.128411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.128656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.128971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.129311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.129630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.129948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.130267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.130589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.130938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.131264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.131590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.131939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.132232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.132549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.132968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.133610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.133933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.134261 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.134606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.134931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.135245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.135686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.135933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_db.sqlalchemy.engines [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.136076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.136319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.136646 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.136968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.137329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.137664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.137985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.138313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.138630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.138970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.139320 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.139656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.139988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.140299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.140610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.140742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writer thread running {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.140919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.141260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.141396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_db.sqlalchemy.engines [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.141588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.141905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.142215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.142523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.142836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.143155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.143528 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.143879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.144197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.144760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.147339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.149445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.149445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.149445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.149445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.150182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.150182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.150474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.150768 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.151089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.151421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.151738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.152069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.152437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.152768 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.153087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.153458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.153837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.154180 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.154503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.154847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.155170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.155488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.155827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.156161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.156504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.157042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.157471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.157761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.158149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.158453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.158824 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.159168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.159490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.159836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.160156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.160477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.160803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.161122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.161473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.161816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.162140 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.162497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.162832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.163152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.163510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.163847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.164982 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.165545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.165913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.166257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.166588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.166915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.167232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:22:01.167665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:22:01.235648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Registered counter for database nova_api Sep 28 12:22:01.257560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.265400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.287986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writer thread running {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.296959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO dbcounter [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Registered counter for database nova_cell0 Sep 28 12:22:01.303960 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_db.sqlalchemy.engines [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.308826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writer thread running {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.325867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.context [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a(cell1) {{(pid=120392) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:22:01.329937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.330420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.332046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.332767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.333251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.335263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.338411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Registered counter for database nova_cell0 Sep 28 12:22:01.343939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Registered counter for database nova_cell1 Sep 28 12:22:01.351858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.356663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.358317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.509769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.519044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Registered counter for database nova_cell0 Sep 28 12:22:01.526858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:22:01.531908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:22:01.637330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: WARNING keystonemiddleware.auth_token [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:22:01.644612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: WARNING keystonemiddleware.auth_token [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:22:01.857300 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:22:01.864967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:22:01.993192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: WARNING keystonemiddleware.auth_token [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:22:01.999426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: WARNING keystonemiddleware.auth_token [None req-91febbe1-c143-49ef-ac58-4e20741fb6e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:22:02.004666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56553e7039c0 pid: 120393 (default app) Sep 28 12:22:02.210027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:22:02.216161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-48e7b5f4-b9a4-4f71-9367-99a8f8388db4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:22:02.221443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56553e7039c0 pid: 120392 (default app) Sep 28 12:22:38.403353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.404384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.405258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.406101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.744162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.746511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.748879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:38.750822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:40.191263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e7d10bbc-eebc-4062-9826-c693ffeba776 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Action: 'create', calling method: .version_select at 0x7fa707c19550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1997192190", "metadata": {"Type": "work"}}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:40.209687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7ee260f1-0a19-49ac-9507-328d176607b2 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Action: 'create', calling method: .version_select at 0x7fa707c174c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1687034534", "metadata": {"Type": "work"}}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7ee260f1-0a19-49ac-9507-328d176607b2 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 122 Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:40.216405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1687034534", "metadata": {"Type": "work"}}} Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:40.217814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1687034534', 'metadata': {'Type': 'work'}}}} Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:40.218631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:22:40.219945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:22:40.221113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:22:40.221113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.230582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7ee260f1-0a19-49ac-9507-328d176607b2 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:40.231679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7ee260f1-0a19-49ac-9507-328d176607b2 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.846497 Sep 28 12:22:40.232249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 12:22:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1849 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:22:40.244678 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8e0e27d7-2a9d-4969-acca-c3bf0b66dacf tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Action: 'create', calling method: .version_select at 0x7fa707c17dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313186792", "metadata": {"Type": "work"}}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8e0e27d7-2a9d-4969-acca-c3bf0b66dacf tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 120 Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:40.259705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313186792", "metadata": {"Type": "work"}}} Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:40.261041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1313186792', 'metadata': {'Type': 'work'}}}} Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi '0' Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:40.261839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:22:40.263957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:22:40.267565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:22:40.267565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.267565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8e0e27d7-2a9d-4969-acca-c3bf0b66dacf tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:40.267565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8e0e27d7-2a9d-4969-acca-c3bf0b66dacf tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022276 Sep 28 12:22:40.267565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 12:22:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:22:40.277559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aa23c06c-2360-4bbf-bc27-99d58ffdae0c tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Action: 'create', calling method: .version_select at 0x7fa707ad61f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2071936022", "metadata": {"Type": "work"}}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aa23c06c-2360-4bbf-bc27-99d58ffdae0c tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 119 Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:40.285593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2071936022", "metadata": {"Type": "work"}}} Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:40.286908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2071936022', 'metadata': {'Type': 'work'}}}} Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi '' Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:40.287771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:22:40.289532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:22:40.292412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:22:40.292412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:40.292412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aa23c06c-2360-4bbf-bc27-99d58ffdae0c tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:40.292412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-aa23c06c-2360-4bbf-bc27-99d58ffdae0c tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019060 Sep 28 12:22:40.292412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 12:22:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:22:40.304569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e4932cb8-ac32-42cd-b6a4-12d7287e577b tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Calling method '.version_select at 0x7fa707ad6ca0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:42.319970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-e4932cb8-ac32-42cd-b6a4-12d7287e577b tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] HTTP exception thrown: Volume tempest-invalid-282259774 could not be found. Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e4932cb8-ac32-42cd-b6a4-12d7287e577b tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-282259774 HTTP/1.1 Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:42.325935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume tempest-invalid-282259774 could not be found. Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'tempest-invalid-282259774'} Sep 28 12:22:42.327483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-282259774 could not be found. (HTTP 404) (Request-ID: req-dfb6fc1b-c5a0-49e6-b4f5-bae9790f855d) Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.328331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:22:42.330235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-282259774 could not be found. Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:22:42.370045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-282259774 could not be found. Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-282259774 could not be found. Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e4932cb8-ac32-42cd-b6a4-12d7287e577b tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 404 to user: Volume tempest-invalid-282259774 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e4932cb8-ac32-42cd-b6a4-12d7287e577b tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-282259774" status: 404 len: 98 microversion: 2.1 time: 2.034295 Sep 28 12:22:42.377214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 28 12:22:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-282259774 => generated 98 bytes in 2036 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 28 12:22:42.380163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-56dba92f-69e3-4f59-a5ff-99629ae04f70 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011936 Sep 28 12:22:42.380163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 28 12:22:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 12:22:42.380163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-58b89626-7eee-423a-9b38-4c8eafb11c1d tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009413 Sep 28 12:22:42.380163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 28 12:22:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 28 12:22:42.386320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3b84d26a-22e8-4e9a-be55-7186688d5d0e tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Calling method '.version_select at 0x7fa707a08430>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:42.882640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e7d10bbc-eebc-4062-9826-c693ffeba776 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.161797 Sep 28 12:22:42.883277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 1/7] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 12:22:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4164 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 12:22:42.900827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4c8712f4-88f7-4d04-b248-ec5a2ef485a1 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707aee430>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:42.904861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-3b84d26a-22e8-4e9a-be55-7186688d5d0e tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] HTTP exception thrown: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3b84d26a-22e8-4e9a-be55-7186688d5d0e tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/os-volumes/aa17efec-f2bb-45ed-9f03-2cac6d24fb0b HTTP/1.1 Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:42.907454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'aa17efec-f2bb-45ed-9f03-2cac6d24fb0b'} Sep 28 12:22:42.908421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. (HTTP 404) (Request-ID: req-f644623c-daad-491d-8b6f-1083aa6e3da4) Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.908990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:22:42.910457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:22:42.911370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3b84d26a-22e8-4e9a-be55-7186688d5d0e tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 404 to user: Volume aa17efec-f2bb-45ed-9f03-2cac6d24fb0b could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3b84d26a-22e8-4e9a-be55-7186688d5d0e tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/aa17efec-f2bb-45ed-9f03-2cac6d24fb0b" status: 404 len: 109 microversion: 2.1 time: 0.531907 Sep 28 12:22:42.915460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:22:42 2022] DELETE /compute/v2.1/os-volumes/aa17efec-f2bb-45ed-9f03-2cac6d24fb0b => generated 109 bytes in 533 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:22:42.919309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0314be23-cde8-4b31-9b6c-2b6406465725 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Calling method '.version_select at 0x7fa707a081f0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:43.063021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-0314be23-cde8-4b31-9b6c-2b6406465725 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] HTTP exception thrown: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0314be23-cde8-4b31-9b6c-2b6406465725 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Request method failure captured: Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/os-volumes/50f52ed5-47f2-4a85-a056-639f30ec577e HTTP/1.1 Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOg1VN1dPZ-etx43b4hlwaQqajdTuHltAp0XdIo63KUtDdF8jjIK7_nrXt69hBWbwfD2mmw7icOahjVpa_1DQTN_vPeJqeUGZVrZQ53pYSgevP4NanvRzUIdQLlEQQpkRkXgPADM-H_8WiVz213h0dRXGFpaeHGap3TCkHONnZplo Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:43.064943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f19c33b4bea04ee582a9424c2ddfdade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f19c33b4bea04ee582a9424c2ddfdade", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f19c33b4bea04ee582a9424c2ddfdade"}]}] Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: f19c33b4bea04ee582a9424c2ddfdade Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesNegativeTest-783505141 Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 0e4b2eb9978342ab80e698151fdcf049 Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesNegativeTest-783505141-project Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '50f52ed5-47f2-4a85-a056-639f30ec577e'} Sep 28 12:22:43.066275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. (HTTP 404) (Request-ID: req-a38b3c25-d40b-49df-bcd5-339b4c9fbb88) Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:43.067038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:22:43.068123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:22:43.069379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0314be23-cde8-4b31-9b6c-2b6406465725 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] Returning 404 to user: Volume 50f52ed5-47f2-4a85-a056-639f30ec577e could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0314be23-cde8-4b31-9b6c-2b6406465725 tempest-VolumesNegativeTest-783505141 tempest-VolumesNegativeTest-783505141-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/50f52ed5-47f2-4a85-a056-639f30ec577e" status: 404 len: 109 microversion: 2.1 time: 0.151663 Sep 28 12:22:43.070217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 8/9] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:42 2022] GET /compute/v2.1/os-volumes/50f52ed5-47f2-4a85-a056-639f30ec577e => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:22:43.229278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4c8712f4-88f7-4d04-b248-ec5a2ef485a1 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 200 len: 353 microversion: 2.1 time: 0.334576 Sep 28 12:22:43.232189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 2/10] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:42 2022] GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 353 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:44.252638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f38693a7-2693-477a-85a4-f1e6d4b05e31 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707ad9160>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:44.390695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f38693a7-2693-477a-85a4-f1e6d4b05e31 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 200 len: 354 microversion: 2.1 time: 0.143110 Sep 28 12:22:44.401756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 9/11] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:44 2022] GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:44.409554 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77d9b12b-5a7b-4df4-935b-5c6c25b8602f tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707aeeaf0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:44.557757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77d9b12b-5a7b-4df4-935b-5c6c25b8602f tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 200 len: 354 microversion: 2.1 time: 0.156216 Sep 28 12:22:44.558653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 3/12] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:44 2022] GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:44.572915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-891ff687-8177-4d84-a4ba-1f8359a75128 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707a08790>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:45.056740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-891ff687-8177-4d84-a4ba-1f8359a75128 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 202 len: 0 microversion: 2.1 time: 0.488235 Sep 28 12:22:45.057708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 10/13] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:22:44 2022] DELETE /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:22:45.070445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3e409126-f154-430a-a568-b920df450178 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707a861f0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:45.207570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3e409126-f154-430a-a568-b920df450178 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 200 len: 353 microversion: 2.1 time: 0.143985 Sep 28 12:22:45.208725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 4/14] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:45 2022] GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:46.227182 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ecd21129-b72e-4b21-a42c-80da751882f2 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Calling method '.version_select at 0x7fa707a08160>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:46.271906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-ecd21129-b72e-4b21-a42c-80da751882f2 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] HTTP exception thrown: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ecd21129-b72e-4b21-a42c-80da751882f2 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Request method failure captured: Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab HTTP/1.1 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyOF7BM9RBoOYMRveU0-g2g9SUGAd82kH9IwrSfwDY8IbtYdOT8SqQrr9DrjIls3heHLXuIe6ImBjbO-PSkowA3iukBk-8UOZea22Wht8UMaot-CTc6jqrxFo9-A5tLYHtcLMYgeGRuumbscRctWwrYTu484OB97ZpPJZ07xtR48R8 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: bb55541c8a31486494dac11aa5c84e37 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesGetTestJSON-1786580750 Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:22:46.274363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb55541c8a31486494dac11aa5c84e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb55541c8a31486494dac11aa5c84e37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb55541c8a31486494dac11aa5c84e37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb55541c8a31486494dac11aa5c84e37"}]}] Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesGetTestJSON-1786580750 Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: bb55541c8a31486494dac11aa5c84e37 Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesGetTestJSON-1786580750 Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesGetTestJSON-1786580750-project Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 98290356ebed4635a170716391152f57 Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesGetTestJSON-1786580750-project Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '04d0be16-b17b-483b-ac3d-9000eae22fab'} Sep 28 12:22:46.275771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. (HTTP 404) (Request-ID: req-270015d4-d548-4a71-95e6-f05d78bd79c1) Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:46.276566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:22:46.277751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:22:46.279136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. Sep 28 12:22:46.282186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:22:46.285078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ecd21129-b72e-4b21-a42c-80da751882f2 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] Returning 404 to user: Volume 04d0be16-b17b-483b-ac3d-9000eae22fab could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:22:46.288046 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ecd21129-b72e-4b21-a42c-80da751882f2 tempest-VolumesGetTestJSON-1786580750 tempest-VolumesGetTestJSON-1786580750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab" status: 404 len: 109 microversion: 2.1 time: 0.068990 Sep 28 12:22:46.289346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 11/15] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:46 2022] GET /compute/v2.1/os-volumes/04d0be16-b17b-483b-ac3d-9000eae22fab => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:22:48.764003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-82c028ce-a72e-4a60-81ef-d5412ae723a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: .version_select at 0x7fa707aeee50>, body: {"keypair": {"name": "tempest-keypair-23839771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGzB7vphqIwUA07bv+rYSpT28jZYEmW+iQkr/rtBdYlNelixdChzSZOYQ5dR3TRS+Bcii0A1C8Wkmrl507KloEF9LleFpKqvRMSbzxGHrXjlg6MyiQXDKGAd5mYjl0Vzg=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:48.890743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-82c028ce-a72e-4a60-81ef-d5412ae723a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for project a396283cd8314a74bfd5e411c246cc96. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:22:48.907897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-82c028ce-a72e-4a60-81ef-d5412ae723a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for user 4d7b7c68a699443aa5c0859094c265ec and project a396283cd8314a74bfd5e411c246cc96. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:22:48.995703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-82c028ce-a72e-4a60-81ef-d5412ae723a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.787586 Sep 28 12:22:48.996606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 5/16] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 28 12:22:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 789 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 12:22:55.098219 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7847cb99-3b60-4264-8c98-38c815a142de tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: .version_select at 0x7fa707a080d0>, body: {"keypair": {"name": "tempest-keypair-1773603324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKJoE6u7fW1tSnKWwdcgggukRsqMIx4v8sQ4RDwFlvnGZzjn4mecQcn57kQASjGsTegxFkVeJ6VDxZSdf+AkRimhp/nBAFcuCGk5T1QXD2SvIEtowcMIA7opGA5RQWuEg=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:55.221020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8b0611d0-fd0b-4867-a3ef-9fa3c1c98940 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa707a639d0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:55.261148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-7847cb99-3b60-4264-8c98-38c815a142de tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:22:55.290717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-7847cb99-3b60-4264-8c98-38c815a142de tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:22:55.315682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8b0611d0-fd0b-4867-a3ef-9fa3c1c98940 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f01f4b93-b898-463b-90e7-e642a65f1e84" status: 200 len: 351 microversion: 2.1 time: 0.098770 Sep 28 12:22:55.324118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 6/17] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:22:55 2022] GET /compute/v2.1/os-volumes/f01f4b93-b898-463b-90e7-e642a65f1e84 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:55.429417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7847cb99-3b60-4264-8c98-38c815a142de tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.912031 Sep 28 12:22:55.430418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 12/18] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:22:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:56.257448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1735231480", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "networks": [{"uuid": "dd60752d-1269-4318-bcc5-7e8d9f3ecd76"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:56.565206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] validate_networks() for [('dd60752d-1269-4318-bcc5-7e8d9f3ecd76', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:22:56.741993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-964799829", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d52528a4-371a-43c0-ba14-e43c1c223b47"}], "security_groups": [{"name": "tempest-securitygroup--1016351822"}], "key_name": "tempest-keypair-23839771", "user_data": "}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:22:57.277678 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] validate_networks() for [('d52528a4-371a-43c0-ba14-e43c1c223b47', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:22:58.932727 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:59.692033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:22:59.693021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:22:59.694167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:22:59.694696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:22:59.695491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:22:59.733860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:59.736579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:59.737212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:59.741657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:59.742790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:59.743982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:59.842774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for project a396283cd8314a74bfd5e411c246cc96. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:22:59.847851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for user 4d7b7c68a699443aa5c0859094c265ec and project a396283cd8314a74bfd5e411c246cc96. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:22:59.864020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:22:59.868218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:22:59.958877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:22:59.960081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:22:59.960952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:22:59.962100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:22:59.962806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:22:59.993020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:59.997101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:59.999296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:00.000442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:00.001405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:00.003433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:00.013282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a58186a6-a911-484f-8147-9e074f7371e5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.278234 Sep 28 12:23:00.017720 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 13/19] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 28 12:22:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 12:23:00.033474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f903a7bb-4d99-444e-9364-b7d3e63cf806 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa707914f70>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:00.140524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Getting quotas for project 3afaa30b2f454bc0bf1f23ece426339b. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:23:00.149667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Getting quotas for user 95575c3357d4413298c3fa08709c5037 and project 3afaa30b2f454bc0bf1f23ece426339b. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:23:00.181929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:23:00.185056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:23:00.226995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f903a7bb-4d99-444e-9364-b7d3e63cf806 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f4ccb5da-d915-4151-83b7-2cd7bb3c1008" status: 200 len: 351 microversion: 2.1 time: 0.207677 Sep 28 12:23:00.236096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 14/20] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:23:00 2022] GET /compute/v2.1/os-volumes/f4ccb5da-d915-4151-83b7-2cd7bb3c1008 => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:00.244564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:00.247224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:00.439685 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c9d9963c-7b06-47be-83fc-fbcd1a2a7a3f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.121695 Sep 28 12:23:00.449163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 7/21] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:23:00.470664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-523860825", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75ba08fd-c198-48e0-8c9c-8b6efb7d5c44"}], "security_groups": [{"name": "tempest-securitygroup--457825579"}], "key_name": "tempest-keypair-1773603324", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:00.510133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:00.528373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:00.530173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:00.531371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fcf9eabf-e8a5-43d7-bc48-130439408e58 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1279 microversion: 2.20 time: 0.301424 Sep 28 12:23:00.531938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 15/22] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:00 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:00.563171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b877cd83-4ce9-4fe1-8e79-dd53fa324881 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:00.569089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b877cd83-4ce9-4fe1-8e79-dd53fa324881 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:00.652361 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b877cd83-4ce9-4fe1-8e79-dd53fa324881 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:00.661377 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b877cd83-4ce9-4fe1-8e79-dd53fa324881 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1215 microversion: 2.1 time: 0.108022 Sep 28 12:23:00.662828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 16/23] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:00 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:01.335222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] validate_networks() for [('75ba08fd-c198-48e0-8c9c-8b6efb7d5c44', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:23:01.559253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:01.560856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:01.578267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.579222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.580867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:01.581885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.585733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.586451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:01.871548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:01.891317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:01.894495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:01.896950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3f59774b-6055-48f3-968f-0cc644515245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1283 microversion: 2.20 time: 0.343886 Sep 28 12:23:01.897563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 17/24] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:01 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1283 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:01.905732 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:01.906344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:01.923868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.924415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.925048 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:01.925949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.934274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.935826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.046657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:02.055743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6dbb8398-6d31-46c6-bd0b-ef73e9b4eb0d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1219 microversion: 2.1 time: 0.154338 Sep 28 12:23:02.056440 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 18/25] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:01 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:02.173738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:23:02.174417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:23:02.176098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:23:02.176731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:23:02.177655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:23:02.197973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.198702 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.199369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.200327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.201166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.201807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.221078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:23:02.226206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:23:02.237925 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:23:02.241024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:23:02.293169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4538d479-072b-448b-8679-a8387ad560fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.842406 Sep 28 12:23:02.294456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 8/26] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:23:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:23:02.305710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6d7e0677-f661-47c6-b14c-f2f76f363b50 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:02.306396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6d7e0677-f661-47c6-b14c-f2f76f363b50 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:02.386443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6d7e0677-f661-47c6-b14c-f2f76f363b50 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:02.409696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6d7e0677-f661-47c6-b14c-f2f76f363b50 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1241 microversion: 2.1 time: 0.096767 Sep 28 12:23:02.415454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 19/27] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:02 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:02.923962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:02.924638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:02.947388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.957461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.958203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.959164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.959839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.960646 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.080906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:03.081666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:03.090829 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.091355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.091803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.092521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.092982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.093448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.183959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:03.197049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:03.210063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f142ad4f-b2bb-454a-9143-f96fdbb91fde tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1219 microversion: 2.1 time: 0.131226 Sep 28 12:23:03.211057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:03.212858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:03.214463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b9c73f32-27de-4122-841d-d7f765b925e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1283 microversion: 2.20 time: 0.294895 Sep 28 12:23:03.218283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 20/28] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:03 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:03.225492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 9/29] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:02 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1283 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:03.438582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:03.439487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:03.447145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.448142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.448982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.450255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.450693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.451214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.528375 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:03.536286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-604c4c95-86f8-4511-911a-e2d5250ee66e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1245 microversion: 2.1 time: 0.101826 Sep 28 12:23:03.536939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 21/30] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:03 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:04.239037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:04.240596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:04.241015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:04.241739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:04.247489 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.248323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.248632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.248771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.249241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.249775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.250553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.251086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.251590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.253742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.254050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.254488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.325977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:04.327013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:04.335286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:04.337296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bfd1ecae-c31e-4b19-b911-1bb63c001cab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1219 microversion: 2.1 time: 0.105194 Sep 28 12:23:04.337571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:04.338161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 10/31] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:04 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:04.342159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4bd91a65-9846-4325-8393-93a54f18a7f8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1283 microversion: 2.20 time: 0.106062 Sep 28 12:23:04.342745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 22/32] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:04 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:04.559700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:04.560313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:04.566574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.567063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.567611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.568457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:04.569052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:04.569662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.652916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:04.660802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e2312490-7df1-429c-8c11-2d2a229c1e8f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1245 microversion: 2.1 time: 0.104694 Sep 28 12:23:04.673849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 11/33] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:04 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:05.362094 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:05.362718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:05.369667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.370391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.371050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.371981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.372563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.373061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.382232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:05.383231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:05.393615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.394982 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.396406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.398048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.414546 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.417173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.456873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:05.466286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7eeb530f-5437-4f39-ae97-84c10e072bab tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1267 microversion: 2.1 time: 0.108671 Sep 28 12:23:05.467376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 23/34] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:05 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:05.533654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:05.545887 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:05.547334 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:05.548665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f38055e6-c9eb-4fba-9a59-54fde3913c24 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1275 microversion: 2.20 time: 0.172759 Sep 28 12:23:05.549243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 12/35] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:05 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:05.685914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:05.686531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:05.693060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.693585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.694202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.695095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.695708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.696139 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.789282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:05.805888 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4f6ed52c-0c2d-415a-bde5-6d1caba2eec6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1237 microversion: 2.1 time: 0.123677 Sep 28 12:23:05.823008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 24/36] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:05 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:06.279172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-57b33eb7-7e90-4237-a0c8-a27f0b2220c7 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa70709e550>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.366390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-57b33eb7-7e90-4237-a0c8-a27f0b2220c7 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/131bf4f7-ecde-4049-b100-fdfce67dc714" status: 200 len: 351 microversion: 2.1 time: 0.091370 Sep 28 12:23:06.367402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 13/37] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes/131bf4f7-ecde-4049-b100-fdfce67dc714 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:23:06.381062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-13452e62-2798-4d4f-b10e-c2b86eeae259 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa7070e9dc0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.493828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.498199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-13452e62-2798-4d4f-b10e-c2b86eeae259 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.121262 Sep 28 12:23:06.498841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 25/38] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:06.499730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:06.516057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-67c3f6d1-7b52-4ed5-83df-84533729ee86 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa707077ca0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.520865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.522109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.522853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.523846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.524378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.524797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.627801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-67c3f6d1-7b52-4ed5-83df-84533729ee86 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.117046 Sep 28 12:23:06.628561 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 26/39] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:06.641432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.642284 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:06.650929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.651424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.652189 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.652893 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.653542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.654119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.669148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:06.680976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99118a04-1cd7-42d5-bb1b-465d0743287c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1273 microversion: 2.1 time: 0.192597 Sep 28 12:23:06.681607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 14/40] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:06.694386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c84550be-65fa-4e52-92fe-a00385bd492e tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa70709e5e0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.743684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:06.753041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:06.754525 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:06.755891 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-66362db7-88ac-402a-b077-adf0d6c0ec06 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1275 microversion: 2.20 time: 0.126006 Sep 28 12:23:06.756453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 27/41] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:06.813292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c84550be-65fa-4e52-92fe-a00385bd492e tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.122698 Sep 28 12:23:06.814781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 15/42] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:06.828657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4fff7d3d-0ff5-44fb-899d-fcbec0a1ae75 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa706fe4820>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.830371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.830985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:06.882099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.882600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.883050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.887449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.887945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.888391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.980562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4fff7d3d-0ff5-44fb-899d-fcbec0a1ae75 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.155804 Sep 28 12:23:06.991035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 28/43] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:06.995964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-30530a43-44a5-4a93-b8e0-082a73c227d0 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa70706fc10>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.256124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-30530a43-44a5-4a93-b8e0-082a73c227d0 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.263956 Sep 28 12:23:07.267946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 29/44] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:07.277879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d9472022-9753-422e-8415-6b458886f96f tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa706fcd5e0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.312904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:07.325203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b6697372-4d34-4f0a-ac24-f51e311f6c56 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1293 microversion: 2.1 time: 0.495407 Sep 28 12:23:07.326268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 16/45] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1293 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:07.536802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d9472022-9753-422e-8415-6b458886f96f tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.258485 Sep 28 12:23:07.549484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 30/46] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:07.554593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f2da69fb-2b62-43e5-8983-3c47a8977fd6 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa7070f1c10>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.694192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f2da69fb-2b62-43e5-8983-3c47a8977fd6 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.145211 Sep 28 12:23:07.709193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 17/47] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:07.709773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.709773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:07.718942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:07.719373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb7563ff-82bb-4644-a39a-074ec36d03d6 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] Calling method '.version_select at 0x7fa70709e160>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.719501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:07.719873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:07.720582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:07.721047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:07.727091 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:07.949979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb7563ff-82bb-4644-a39a-074ec36d03d6 tempest-VolumesTestJSON-1778098983 tempest-VolumesTestJSON-1778098983-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.235394 Sep 28 12:23:07.950907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 18/48] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:07.975708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.978440 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:07.998165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.000287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.001740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.003580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.005724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.007980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.024391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:08.032848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-53c77484-c212-4ad1-8d25-8da2ce47ecae tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.331887 Sep 28 12:23:08.033758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 31/49] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:08.108619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:08.118990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:08.120476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:08.121613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-da46772e-9759-4180-8427-bbb68cc1c754 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.169574 Sep 28 12:23:08.123299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 19/50] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:08.352110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:08.352804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:08.359744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.360433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.360955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.361852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.362381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.362786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.431586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:08.441326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-000f0b94-88e5-47db-9463-c07a02b3881d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.093477 Sep 28 12:23:08.441326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 32/51] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:08 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:09.057057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:09.057662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:09.063317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.063805 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.064239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.064942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.065424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.065849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.151928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:09.152522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:09.158936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.159683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.160331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.164111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.164844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.165550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.283101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:09.284656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:09.293621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:09.295077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:09.295562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-135aee86-1d86-49df-a04e-dd6c65b024e5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.242447 Sep 28 12:23:09.296137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 20/52] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:09 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:09.296258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-017d632c-183f-4851-b6a8-d103fc90657a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.148341 Sep 28 12:23:09.300535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 33/53] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:09 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:09.463953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:09.464566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:09.481828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.487113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.487875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.488767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.490024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.492169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.590994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:09.603138 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fadf0aaa-c100-47d5-a5e1-c0474b2cd29e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.142787 Sep 28 12:23:09.607708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 21/54] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:09 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:10.320109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:10.321363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:10.324498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:10.325117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:10.325796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:10.330620 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.331184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.331628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.332334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.333864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.334302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.336641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.336985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.337457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.338333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.339101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.339541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.408158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:10.416841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:10.418925 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:10.420047 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-13abbd01-845b-4b18-82e4-1c51ca8b513b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.099825 Sep 28 12:23:10.420667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 22/55] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:10 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:10.474646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:10.482825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-699a7cd8-fd46-45ff-9ac5-70d1ef49ea4b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.166914 Sep 28 12:23:10.483398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 34/56] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:10 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:10.627583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:10.628208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:10.634739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.635218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.635647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.636331 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.636779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.637234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.705636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:10.716057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-46cda411-2093-4860-9dd9-fa58c44ac37f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.092101 Sep 28 12:23:10.716756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 23/57] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:10 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:11.446065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:11.446669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:11.453992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.454474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.454899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.455588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.456034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.456450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.506898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:11.507499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:11.513373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.513849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.514289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.514968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.515410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.515826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.516948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:11.527294 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:11.528870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:11.530078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0c8041e2-2e7c-4cd3-a11b-d9bbe9768db7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.088500 Sep 28 12:23:11.530924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 35/58] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:11 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:11.662566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:11.670841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4784bc81-f3c7-4f86-bc35-6884eeee0701 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.168501 Sep 28 12:23:11.671412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 24/59] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:11 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:11.740708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:11.741449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:11.749959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.750480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.750910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.751611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.752062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.752483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.815687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:11.824601 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3acbb6e6-fde8-4ac2-9220-96c67ca4c198 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.088289 Sep 28 12:23:11.825214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 36/60] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:11 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:12.556817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:12.558163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:12.564210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:12.565193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=12 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:12.567803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.568974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.570065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.570897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.571423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.571842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.645848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:12.654400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:12.655837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:12.656915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3d8d4f60-4402-4345-870a-75905aaaac35 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.105456 Sep 28 12:23:12.657493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 25/61] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:12 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:12.695308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:12.695923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:12.697787 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=16 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:12.703485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.703982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.704427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.705147 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.705609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.706031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.850961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:12.853327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:12.863383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.864341 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.865005 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.867111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.867971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.869290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.875527 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:12.887682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3cc32068-1736-4a59-a923-89cbe62dd5cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.196792 Sep 28 12:23:12.888424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 37/62] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:12 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:12.947509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:12.956020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c47d2f9-2f78-4cfa-89d8-eabd9af3c0ca tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.111845 Sep 28 12:23:12.956903 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 26/63] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:12 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:13.682082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:13.682684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:13.688603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.689076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.689531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.690205 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.690649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.691061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.750576 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:13.758376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:13.759845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:13.760927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b91a234f-1431-4737-8ca4-937f0390bf28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.082816 Sep 28 12:23:13.761511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 38/64] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:13 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:13.913182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:13.913792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:13.919900 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.920476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.920912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.921632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.922078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.922501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.981782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:13.982381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:13.988296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.988818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.989827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.990697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.991150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.991575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.995592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:14.062680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:14.067751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:14.074298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-03b4e284-cea8-40f1-8ddf-711d03982111 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.165667 Sep 28 12:23:14.075906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 27/65] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:13 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:14.082436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e8711ff5-ee92-4c0d-a44f-af136da03c21 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.104469 Sep 28 12:23:14.094374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 39/66] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:13 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:14.786252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:14.786961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:14.793070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:14.793590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:14.794027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:14.794743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:14.795276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:14.795598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:14.869984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:14.875491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:14.884387 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:14.886812 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:14.888414 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-414dc4eb-04f1-435e-a8dd-b9562a811680 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.105974 Sep 28 12:23:14.889260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 28/67] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:14 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:15.101877 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:15.102508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:15.107553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:15.108420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.108666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:15.108902 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.109364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.110047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.110495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.110916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.115207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.115921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.116268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.116946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.117563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.117974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.195725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:15.203490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8c26ebb8-e9b0-40ea-be68-a2c6333532cd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.099632 Sep 28 12:23:15.204057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 29/68] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:15 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:15.265764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:15.273595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-229622ab-5055-404b-a391-813043fed2d0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.175965 Sep 28 12:23:15.274156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 40/69] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:15 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:15.930084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:15.930681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:15.936569 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.937003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.937456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.938124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.938565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.938977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.998500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:16.006939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:16.008371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:16.009488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4e1ae82-76da-4552-8e51-9040e25e9531 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.083391 Sep 28 12:23:16.010037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 30/70] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:15 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:16.227120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:16.227696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:16.233930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.234414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.234843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.235528 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.235983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.236402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.298070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:16.298690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:16.314628 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.315130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.315575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.316287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.316746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.322758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:16.323194 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.333269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-aeac5812-f989-411c-875f-372e1eaaae16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.109833 Sep 28 12:23:16.334233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 41/71] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:16 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:16.454197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:16.462294 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ec11149a-1361-4daf-a85d-893a09b70085 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.168940 Sep 28 12:23:16.462851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 31/72] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:16 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:17.035191 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:17.035940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:17.042157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.042737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.043218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.044089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.044564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.045027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.108184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:17.117472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:17.119217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:17.120493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e313628b-9503-4b08-b7b5-69c27cb954a6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.089312 Sep 28 12:23:17.121618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 42/73] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:17 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:17.356834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:17.358902 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:17.366487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.366966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.367397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.368122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.368774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.369216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.435700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:17.444143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-65772413-2a5e-42c5-838b-a103d2a617a7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.091004 Sep 28 12:23:17.444751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 32/74] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:17 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:17.486434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:17.487032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:17.493949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.494700 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.495132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.495828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.496279 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.496694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.639411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:17.647532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8e011bbe-c127-49af-acd6-149534517651 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.164882 Sep 28 12:23:17.648106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 43/75] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:17 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:18.146468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:18.147005 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:18.152797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.153308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.153740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.154412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.154858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.155268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.215073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:18.222923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:18.224802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:18.225912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d15837f-6b32-44e7-93d2-b5da0aff574f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.084008 Sep 28 12:23:18.226461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 33/76] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:18 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:18.466697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:18.467302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:18.474090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.474649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.475076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.475748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.476211 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.476631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.540108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:18.547784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-91fb8e81-7308-46e3-9c24-514a4f169ff1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.084793 Sep 28 12:23:18.548349 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 44/77] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:18 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:18.672271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:18.673311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:18.680113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.680596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.681024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.681747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.682191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.693269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.834425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:18.846491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fd6ce9f5-bff6-494b-99d4-81ca01acba65 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.178978 Sep 28 12:23:18.860809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 34/78] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:18 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:19.251999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:19.253003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:19.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.261880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.262316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.263020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.263472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.263894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.328370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:19.337092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:19.338588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:19.339691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bd2bfe89-3553-42a4-83ec-167f8e864fba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.092179 Sep 28 12:23:19.340432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 45/79] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:19 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:19.571201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:19.571799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:19.573663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:19.578915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.579393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.579820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.580493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.580937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.581380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.644435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:19.652656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0d9cde69-52ba-4830-87c7-2bd82f1f89e6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.086137 Sep 28 12:23:19.653228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 35/80] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:19 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:19.891483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:19.892843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:19.904797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.905331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.905769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.906475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.906929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.907352 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.047959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:20.056873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-953bd01a-457f-48b9-abb9-4f0c2ddeff15 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.169090 Sep 28 12:23:20.057573 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 46/81] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:19 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:20.366924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:20.367531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:20.373386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.373866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.374298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.374980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.375428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.375847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.437114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:20.445190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:20.446634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:20.447726 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-04faf923-fdbe-43fa-8f6e-433c13793cef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.085450 Sep 28 12:23:20.448276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 36/82] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:20 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:20.675543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:20.676954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:20.682894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.683316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.683747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.684420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.684867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.685316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.745568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:20.753079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0c376dba-326e-4740-a7dc-1e5f44c6ce44 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.081365 Sep 28 12:23:20.753870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 47/83] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:20 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:21.080794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:21.081526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:21.093597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.094089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.094524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.095252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.095713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.096134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.252675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:21.261851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8f9f42e9-75e9-48c9-8067-965a6cf9665d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.185534 Sep 28 12:23:21.262416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 37/84] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:21 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:21.472112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:21.472816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:21.479307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.479818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.480219 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.480925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.481407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.481828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.560049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:21.568945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:21.571069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:21.572630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e4aea85f-3a65-4416-b6d3-685070069aad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.104145 Sep 28 12:23:21.573404 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 48/85] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:21 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:21.785946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:21.787354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:21.794411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.795435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.796359 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.797432 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.797884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.798458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.882984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:21.891984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-54203319-3c24-4a10-9fe7-60ade1e2ffb8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.112505 Sep 28 12:23:21.892556 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 38/86] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:21 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:22.285639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:22.286555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:22.292532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.293017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.293504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.294201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.294655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.295093 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.434491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:22.442756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-25fbfb9b-7d68-4f02-820c-8e9504bcbb0b tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.161150 Sep 28 12:23:22.443315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 49/87] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:22 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:22.597038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:22.597793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:22.604074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.604548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.604971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.605676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.606281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.606704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.677302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:22.686479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:22.687916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:22.689240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-83c77ea1-3d3c-4f73-b24a-d25f1e34de5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1331 microversion: 2.20 time: 0.096127 Sep 28 12:23:22.690031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 39/88] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:22 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:22.916353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:22.916956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:22.923259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.924112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.924790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.925639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.926797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.927360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.055811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:23.066330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fe9def5f-4b3f-40c9-b391-262c3dbe3fac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1299 microversion: 2.1 time: 0.153635 Sep 28 12:23:23.085780 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 50/89] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:22 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:23.471790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:23.474421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:23.486301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.487828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.489179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.490656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.491297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.492929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.715526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:23.716127 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:23.719135 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:23.724087 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.725359 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.725895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.726788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.727238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.727660 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.912822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:23.930813 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:23.932264 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:23.933599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-453991e8-98d8-4cc1-ad09-1688bba6f567 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1337 microversion: 2.20 time: 0.222997 Sep 28 12:23:23.934467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 51/90] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:23 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1337 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:24.092049 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:24.100403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:24.101011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:24.112999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7bbe803b-3a03-443d-96b0-3436c8b6e893 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.648697 Sep 28 12:23:24.114988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:24.115487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:24.115920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:24.116626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:24.117266 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:24.117524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:24.134260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 40/91] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:23 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:24.519428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:24.534153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-33c3824f-b0a2-4984-a965-dcf6c6a8b74c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.444000 Sep 28 12:23:24.534956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 52/92] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:24 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:24.961210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:24.961845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:24.974669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:24.975515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:24.976148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:24.980132 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:24.987506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:24.988311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.141697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:25.142666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:25.154289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.154898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.158035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.159035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.159782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.162101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.244375 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:25.271543 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:25.273652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:25.275003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b60063e6-06bc-46a1-bd52-5031b96e96f5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1337 microversion: 2.20 time: 0.319197 Sep 28 12:23:25.275764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 41/93] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:24 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1337 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:25.561397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:25.562994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:25.575105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.577260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.577865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.579566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.583470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.584843 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.603660 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:25.647936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3ccdc023-5a29-4057-a07e-1dcb26421016 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.509130 Sep 28 12:23:25.650155 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 53/94] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:25 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:25.967084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:25.976717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7f27a707-2f82-4b63-93c5-aebbb251e7f8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.418755 Sep 28 12:23:25.977387 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 42/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:25 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:25.997374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f4d7a5-a42f-4ce7-bf29-b689265cceba", "tag": "7db57789-d5c3-4711-9222-79c5c2dd7daa"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:26.015555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.016395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.018350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.067195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Creating event network-changed:7db57789-d5c3-4711-9222-79c5c2dd7daa for instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba on hv-cinder-84456 Sep 28 12:23:26.069032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 12:23:26.069476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5be4dff4-4ee4-40a5-90d9-5ff5813985e0 req-882143d9-20ea-4047-bba1-514a3982a2fa service nova] Acquired lock "compute-rpcapi-router" {{(pid=120393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 12:23:26.070540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.071005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.071430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.072142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.072742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.073358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.102731 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.compute.rpcapi [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 12:23:26.109817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] Releasing lock "compute-rpcapi-router" {{(pid=120393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 12:23:26.142266 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d1960d61-437c-4745-aeed-7c83b0f953ce None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477359 Sep 28 12:23:26.143105 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 54/96] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:26.303484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:26.304360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:26.314711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.315688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.319316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.320690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.321615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.322039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.478811 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:26.487634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:26.489335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:26.490618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3f53c503-80f5-49f0-ba48-781ad0956586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.192807 Sep 28 12:23:26.491169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 43/97] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:26 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:26.675555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:26.676251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:26.682769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f056349e-a0dd-4179-8cc2-2e3c77d54210", "tag": "9aa52a1f-1b14-4e05-b50f-fcecfa618b5a"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:26.686602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.687076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.687643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.688430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.688771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.689216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.697025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.698033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.698647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.716240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] Creating event network-changed:9aa52a1f-1b14-4e05-b50f-fcecfa618b5a for instance f056349e-a0dd-4179-8cc2-2e3c77d54210 on hv-cinder-84456 Sep 28 12:23:26.722967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-4d99cc4a-4af2-453f-8543-131e536acdfb req-2371fbd6-037f-4aeb-b81c-aca8f351b5f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324370 Sep 28 12:23:26.728593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 55/98] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:26.850688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:26.862250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e0850c4f-4b57-4bcd-8796-daa9a9fcbba0 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.191067 Sep 28 12:23:26.863627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 44/99] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:26 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:27.000510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:27.001516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:27.009615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.012028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.012644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.013632 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.014118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.014686 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.188222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:27.192327 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:27.198461 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3a8da265-0be9-4897-8c90-f67cc655dff7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.202069 Sep 28 12:23:27.199339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 56/100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:26 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:27.517502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:27.518093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:27.524626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.525359 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.525793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.526481 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.527188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.527871 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.546767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:27.679342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:27.688950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:27.690835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:27.692421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-23c105e3-cc4a-4c17-9ce8-54d827b24ce8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.178965 Sep 28 12:23:27.693491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 45/101] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:27 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:27.886096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:27.886999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:27.894705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.895374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.895993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.896903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.897564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.898176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.202371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:28.214745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3f42fe10-d23e-435d-88e9-6d14835b1dac tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.332918 Sep 28 12:23:28.218603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 57/102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:27 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:28.224039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:28.224643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:28.235316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.235828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.236414 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.238910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.239391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.239817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.720943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:28.722914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:28.735171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.736712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.739842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.740624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.741468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.742071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.907937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:28.919392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c4aa7afb-2743-4d87-b8b5-10fa235940fc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.699283 Sep 28 12:23:28.930413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 46/103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:28 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:29.093794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:29.112707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:29.114883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:29.116396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e89db41-460e-4bd9-8821-a1b06826824b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.400135 Sep 28 12:23:29.117161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 58/104] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:28 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:29.245503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:29.246255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:29.252647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.253390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.254351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.255220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.256874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.257548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.523030 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:29.533162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-adfe33ab-6352-4c14-9b39-69523843a07d tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.291204 Sep 28 12:23:29.534099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 47/105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:29 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:29.652876 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:29.664783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.665350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.666872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.684801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] Creating event network-changed:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:23:29.693507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-1b6f6c0c-852a-4ff8-9f86-3f7c9b07a593 req-8dda43ac-286b-41ae-a54d-6950188ec1aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045229 Sep 28 12:23:29.695082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 59/106] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:29.945999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:29.946633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:29.952498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.952968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.953439 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.954108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.954550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.954964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.090899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:30.099648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-355a272a-a21b-4fd0-9eeb-48455eb024e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.157597 Sep 28 12:23:30.100222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 48/107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:29 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:30.147176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:30.147855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:30.154680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.155234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.155822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.156659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.157912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.158592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.311500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:30.321480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:30.323069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:30.324289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2b27433e-ee67-446f-a789-36b62d0acc8b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.182118 Sep 28 12:23:30.324970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 60/108] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:30 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:30.559770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:30.560424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:30.567529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.567964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.568388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.569072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.569558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.569976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.708386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:30.717055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-507ea101-06eb-44e5-9c92-da7ef9b88381 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.161232 Sep 28 12:23:30.717923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 49/109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:30 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:31.123990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:31.124609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:31.131232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.131714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.132145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.132827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.133300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.134051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.280946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:31.289841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-cc476fb9-0589-4d25-b16b-c5af08099376 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.170912 Sep 28 12:23:31.290408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 61/110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:31 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:31.350723 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:31.351572 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:31.357369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.357854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.358293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.359015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.359459 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.359876 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.488425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:31.497117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:31.498964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:31.500073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c087ed0e-5867-403c-8957-e2247cfbecf9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.154249 Sep 28 12:23:31.500631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 50/111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:31 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:31.746460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:31.746460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:31.748664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.749183 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.749737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.750452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.750885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.751306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.889448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:31.905221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3d7d2e20-d94b-444f-944b-1f9d4f7418df tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.168423 Sep 28 12:23:31.905811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 62/112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:31 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:32.312267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:32.313048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:32.322254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.325496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.326011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.326780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.327301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.327784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.503486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:32.512243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3798d501-08c6-44bb-a243-39e37e926edc tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.203885 Sep 28 12:23:32.512895 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 51/113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:32 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:32.524788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:32.525405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:32.531269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.531746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.532174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.532852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.533437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.533857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.677252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:32.694033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:32.695920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:32.697420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d45f1ff7-740a-452a-a988-bd7d71a7ce5a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.176313 Sep 28 12:23:32.698019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 63/114] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:32 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:32.928799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:32.929422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:32.935515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.936020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.936447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.937155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.937626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.938044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.067660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:33.075098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4c7d9d6a-7e5f-4997-939f-05b6c2b1ad33 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.150694 Sep 28 12:23:33.075682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 52/115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:32 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:33.536355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:33.536922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:33.542980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.543460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.543895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.544578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.545034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.545486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.671936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:33.679602 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4ff28afe-9999-4797-b1c0-06dd405c443d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.147752 Sep 28 12:23:33.680201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 64/116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:33 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:33.724478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:33.725078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:33.730905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.731375 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.731806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.732480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.732921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.733363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.866362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:33.875480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:33.877379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:33.879342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-94f3ce1e-c1d2-4a7a-85f0-84d1c4277f30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.158931 Sep 28 12:23:33.880135 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 53/117] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:33 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:34.097921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:34.098733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:34.104541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.105027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.105507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.106194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.106651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.107076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.233102 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:34.241414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-50527aa9-4724-4dfe-855d-33bc1cda4ce3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.147342 Sep 28 12:23:34.241978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 65/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:34 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:34.702470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:34.703085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:34.709328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.710111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.710547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.711500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.711956 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.712381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.840095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:34.848931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d6e26fee-1739-465c-bea3-794324a0c468 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.149870 Sep 28 12:23:34.849594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 54/119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:34 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:34.903653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:34.904252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:34.910736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.911205 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.911634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.912305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.912749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.913187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.043195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:35.051306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:35.052765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:35.053883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-08864664-346c-41b4-ad1a-0559844fc625 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.154083 Sep 28 12:23:35.054433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 66/120] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:34 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:35.264664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:35.265208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:35.271875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.272355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.272778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.273497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.273942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.274358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.401652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:35.409072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7987bd7b-0f57-4f70-b663-55955e022787 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.148495 Sep 28 12:23:35.409897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 55/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:35 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:35.874324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:35.875118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:35.882449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.882936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.883368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.884057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.884508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.884928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.019544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:36.027269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a2e19508-e5dc-478d-be33-262d7f6b19d5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.158014 Sep 28 12:23:36.027823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 67/122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:35 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:36.078539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:36.079234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:36.085038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.085552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.085985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.086666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.087113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.087533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.220761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:36.229919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:36.231395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:36.232449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b65c3ce-0a40-4a79-aabc-131895d17703 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.157806 Sep 28 12:23:36.234958 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 56/123] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:36 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:36.433082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:36.433743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:36.435769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:36.441232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.442027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.442468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.443166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.443627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.444052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.572505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:36.579883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-05643f27-73cd-4c68-ae53-a5e773f13b48 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.150712 Sep 28 12:23:36.580437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 68/124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:36 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:37.050659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:37.051615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:37.057970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.058440 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.058910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.059615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.060094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.060545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.274524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:37.275321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:37.288261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.289598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.290280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.293540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.294345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.296721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.471851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:37.480977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:37.482476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:37.483597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-86403ea1-aa03-4d93-9b44-9624893165be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.229545 Sep 28 12:23:37.484156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 69/125] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:37 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:37.604219 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:37.604837 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:37.611808 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.612307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.613108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.613856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.614320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.614748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.760516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:37.772961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3c65697b-6e25-40c8-9c27-08e1446b1191 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.172060 Sep 28 12:23:37.782710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 70/126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:37 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:37.791156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:37.803939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aa39e747-d08d-4632-b53a-e317a17b9ef1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.756915 Sep 28 12:23:37.804771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 57/127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:37 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:38.508406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:38.509005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:38.517034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.520892 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.521375 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.522092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.522552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.522981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.694400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:38.703360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:38.705574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:38.707776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-beab7b81-cf2d-4624-ac61-99a7c8c2634d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.203305 Sep 28 12:23:38.708825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 71/128] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:38 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:38.797635 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:38.798454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:38.808939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.809420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.810346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.811659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.812297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.813195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.829479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:38.830568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:38.844067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.845516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.846229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.850082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.850904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.852303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.023100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:39.030899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2f93afcd-fdcd-40c4-a929-0999822cb206 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.238024 Sep 28 12:23:39.031473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 58/129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:38 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:39.066710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:39.074664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0196469c-f460-4b24-86c5-96a15024fcea tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.250427 Sep 28 12:23:39.075361 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 72/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:38 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:39.137930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f056349e-a0dd-4179-8cc2-2e3c77d54210", "name": "network-vif-plugged", "status": "completed", "tag": "9aa52a1f-1b14-4e05-b50f-fcecfa618b5a"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:39.152819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.153327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.153752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.180361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Creating event network-vif-plugged:9aa52a1f-1b14-4e05-b50f-fcecfa618b5a for instance f056349e-a0dd-4179-8cc2-2e3c77d54210 on hv-cinder-84456 Sep 28 12:23:39.180912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 12:23:39.181692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-042fa10c-a761-4557-9df6-3b75e7ea9343 req-75e61937-396f-4d55-ae07-8a01ace58f93 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 12:23:39.182771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.183564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.183951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.184954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.185578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.186161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.197810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.compute.rpcapi [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 12:23:39.198722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 12:23:39.220242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4bcf6fed-11ba-406b-b1ba-5ffdd55417d3 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181700 Sep 28 12:23:39.221050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 59/131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:39.735736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:39.736336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:39.744029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.744527 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.744955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.746017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.746665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.747521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.898589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:39.906945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:39.908640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:39.910865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d777a594-910b-4b58-878e-5c2c6f73df30 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.179162 Sep 28 12:23:39.911809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 73/132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:39 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:40.057549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:40.058332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:40.066675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.068457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.069483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.070389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.070939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.071599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.110016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:40.110619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:40.117662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.118379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.118992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.119836 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.120436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.121035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.125707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:40.255316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:40.266667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c39b15f7-14f8-47f6-813c-2014c86274ce tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.213235 Sep 28 12:23:40.267678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 60/133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:40 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:40.284269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:40.292649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f41b4408-60fa-45f3-94d0-9956bdff678c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.186323 Sep 28 12:23:40.293233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 74/134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:40 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:40.935701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:40.936309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:40.942345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.942821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.943249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.943934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.944383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.944806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.083864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:41.091945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:41.093426 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:41.094493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4d31130-44f6-4b33-bb34-680f465145c1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.162722 Sep 28 12:23:41.095042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 61/135] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:40 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:41.292362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:41.292971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:41.298699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.299183 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.299614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.300340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.300788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.301233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.316352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:41.317447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:41.324174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.324651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.325553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.326461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.326964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.327391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.346577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:41.433707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:41.443336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-15e56679-f729-41a3-9206-3f8497ca4c20 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.154990 Sep 28 12:23:41.444264 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 75/136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:41 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:41.472084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:41.480425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fc557441-959b-4324-ba53-e90655052357 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.168442 Sep 28 12:23:41.481001 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 62/137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:41 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:42.122975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:42.123491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:42.130086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.130580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.131015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.131815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.132163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.132587 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.289403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:42.299590 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:42.301295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:42.302549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e2943d2c-d03b-4807-8e29-68dc6f31635a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.183646 Sep 28 12:23:42.303290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 76/138] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:42 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:42.466519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:42.467196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:42.473226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.473956 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.474561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.475246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.475694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.476115 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.502660 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:42.503867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:42.509979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.510477 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.510916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.511615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.512073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.512500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.618705 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:42.626975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e296a4db-0237-412d-9ffd-b5b1b2a009eb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.164422 Sep 28 12:23:42.635633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 63/139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:42 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:42.659909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:42.667690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-256a4d1b-35b4-4fcf-9d42-bb6efb0dc9ee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.168844 Sep 28 12:23:42.668254 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 77/140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:42 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:43.327010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:43.327684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:43.335369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.335860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.336566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.337458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.337917 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.338344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.477619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:43.487419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:43.489353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:43.490466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c4aa0cf6-911a-46bc-ab5b-e6f5c67cb227 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.167590 Sep 28 12:23:43.491028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 64/141] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:43 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:43.652179 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:43.652811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:43.658645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.659119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.659856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.660546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.660989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.661436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.692547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:43.693537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:43.699471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.700060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.700700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.701515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:43.702060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:43.702586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:43.868073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:43.877443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dffd37ee-0314-499c-bf85-e6c3388a73b9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.189846 Sep 28 12:23:43.878931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 65/142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:43 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:43.917124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:43.924628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-760634be-67dd-41e3-b364-ec3794329ada tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.276421 Sep 28 12:23:43.925539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 78/143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:43 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:44.516628 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:44.517304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:44.526376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.526828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.527365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.528927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.529456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.530761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.708999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:44.721327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:44.722781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:44.724689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8e629c07-9060-45e6-bfd9-3b3cee3e390d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.212554 Sep 28 12:23:44.725507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 66/144] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:44 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:44.905103 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:44.906444 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:44.926769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.927214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.927735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.928345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.928791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.929243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.949919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:44.950546 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:44.964083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.964586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.965028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.965765 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.966487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.967262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.345233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:45.362988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-00c7ab71-1e97-4cf3-b02f-175ce10ddabb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.463155 Sep 28 12:23:45.364782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 79/145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:44 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:45.418859 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:45.447471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2c62a6f3-f6b0-462a-9911-34dfc38935d4 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.490854 Sep 28 12:23:45.448823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 67/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:44 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:45.756270 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:45.756776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:45.766384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:45.767855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:45.769084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.770758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:45.771469 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:45.772634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.902130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4d7a5-a42f-4ce7-bf29-b689265cceba", "name": "network-vif-plugged", "status": "completed", "tag": "7db57789-d5c3-4711-9222-79c5c2dd7daa"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:23:45.914930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:45.915401 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:45.915822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.930263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] Creating event network-vif-plugged:7db57789-d5c3-4711-9222-79c5c2dd7daa for instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba on hv-cinder-84456 Sep 28 12:23:45.935392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-a08e5289-e4c6-4d5a-9666-2b424ee09470 req-e9481948-dc41-438f-b8fb-b68c8d1c3af6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040260 Sep 28 12:23:45.935987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 68/147] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:23:45.950000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:45.958063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:45.959487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:45.960575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1260f964-9a75-4664-97ed-682d602955fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.209236 Sep 28 12:23:45.961144 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 80/148] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:45 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:46.401424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:46.402106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:46.408250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.408721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.409156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.409840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.410919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.411344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.479340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:46.479945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:46.485751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.486236 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.486666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.487358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.487812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.488241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.539971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:46.549536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-43999b52-0a59-4525-be9c-f6850bd453ce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.152179 Sep 28 12:23:46.550162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 69/149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:46 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:46.619550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:46.629637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-47fa1eb0-49af-40ff-bfcb-6f5495e45b11 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.153548 Sep 28 12:23:46.630760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 81/150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:46 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:46.987251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:46.989384 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:46.995480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.996152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.996727 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.997660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.998250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.998988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.143713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:47.153426 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:47.159245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:47.159245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-51eb34dc-4fd0-4d7e-a8cf-3804e288c39e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.173250 Sep 28 12:23:47.159245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 70/151] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:46 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:47.571687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:47.572427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:47.578326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.578801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.579226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.579901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.580347 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.580762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.654122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:47.655186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:47.661413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.661894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.662329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.663009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.663456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.663875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.710439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:47.718039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-df6b93ef-156d-44b1-a682-b310206476fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.150039 Sep 28 12:23:47.718612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 82/152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:47 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:47.792397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:47.799928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6a4fde81-0c07-4786-90b5-ee6717ff3e1e tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.149576 Sep 28 12:23:47.800492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 71/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:47 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:48.196018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:48.196626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:48.202484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.202964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.203396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.204082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.204534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.204957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.326069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:48.334024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:48.335470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:48.336563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6c3113b6-9c9c-438b-82ee-d130f4b84d42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.145111 Sep 28 12:23:48.337177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 83/154] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:48 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:48.742201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:48.742794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:48.748799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.749330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.749757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.750424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.750866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.751285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.822964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:48.823555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:48.829927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.830419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.830882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.831577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.832657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.833388 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.879641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:48.887434 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-53f9e6fd-cc89-4cb4-acb4-7dd05c52633a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.149262 Sep 28 12:23:48.888002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 72/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:48 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:48.960232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:48.967750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-59e02548-943b-48d0-a592-e1cf409212bd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.148621 Sep 28 12:23:48.968305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 84/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:48 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:49.362035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:49.362630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:49.364667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:49.370038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.370505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.370928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.371594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.372033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.372442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.501099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:49.511529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:49.511902 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:49.513061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dbcb957b-f9e6-4a23-8357-28e36e15411e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.154863 Sep 28 12:23:49.529921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 73/157] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:49 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:49.911864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:49.912387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:49.918391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.918870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.919301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.919984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.920434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.920853 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.991595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:49.992200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:49.994083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=78 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:49.999952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.000428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.000844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.001731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.002177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.002592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.051460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:50.059567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-50c7c875-cae0-458f-acd1-ff394bff4d83 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.151736 Sep 28 12:23:50.060136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 85/158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:49 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:50.136841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:50.144381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-25bbbed9-07db-40e3-8ddf-56390c1d0fa5 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.157314 Sep 28 12:23:50.145033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 74/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:49 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:50.540393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:50.541518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:50.547011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.547495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.548040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.548732 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.549226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.549679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.680721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:50.688663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:50.690126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:50.691204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b6d147b6-82bf-4528-adca-46d8b691c70e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.154741 Sep 28 12:23:50.692250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 86/160] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:50 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:51.083066 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:51.083678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:51.089578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.090054 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.090485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.091161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.091608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.092022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.167483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:51.168132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:51.174035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.174519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.175129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.176344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.177949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.178387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.224154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:51.232659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-496d6e5c-e68f-4e0c-b8b3-e9c2e247737f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.153595 Sep 28 12:23:51.233385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 75/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:51 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:51.310160 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:51.317710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7ff25ee1-a301-48f1-a93f-42bfc23bcc1c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.154178 Sep 28 12:23:51.318274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 87/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:51 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:51.716873 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:51.717756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:51.725843 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.726333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.726915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.727764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.728402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.728817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.944153 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:51.952392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:51.953874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:51.954960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cdebd184-9271-45a3-8e2b-a75ee4d28dd7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.242131 Sep 28 12:23:51.955512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 76/163] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:51 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:52.256249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:52.256855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:52.262777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.263266 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.263696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.264384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.264836 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.265300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.340296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:52.340910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:52.346715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.347197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.347631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.348572 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.349867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.350406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.389170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:52.397577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c962d11e-b775-45a0-af43-8615bf333cfb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.145164 Sep 28 12:23:52.398157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 88/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:52 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:52.482386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:52.490304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7fb47c33-3fb3-43a1-a1ef-2c97c5653a78 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1315 microversion: 2.1 time: 0.153785 Sep 28 12:23:52.490889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 77/165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:52 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:52.981359 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:52.982114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:52.987952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.988433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.988867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.990335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.990792 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.991218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.126844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:53.142604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:53.144157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:53.145574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5bbd7758-b0b7-4c6b-bf50-0a6318ec790a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.168068 Sep 28 12:23:53.146603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 89/166] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:52 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:53.429800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:53.430405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:53.436276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.436745 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.437191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.437867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.438317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.438733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.514546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:53.515171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:53.523821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.524313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.524749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.525481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.525939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.526358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.569609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:53.577358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c255bd83-3049-4818-af90-8e6db6b0ca85 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.151441 Sep 28 12:23:53.577935 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 78/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:53 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:53.656518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:53.659997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:53.665321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b3fbfa5b-a100-459a-b267-6a8517b9e2fa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1502 microversion: 2.1 time: 0.155234 Sep 28 12:23:53.665878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 90/168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:53 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:23:54.174297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:54.175255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:54.184270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.184980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.185565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.186395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.187196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.187636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.484409 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:54.487766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:54.493164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:54.494605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:54.495693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c62ed42-af50-4fb6-8401-98bf916bba5b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.327577 Sep 28 12:23:54.496244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 79/169] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:54 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:54.601879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:54.602505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:54.604273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=79 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:54.609446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.609938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.610364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.611041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.611482 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.611894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.735424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:54.743365 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c9057843-de77-4304-82bb-c51fecd1c593 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.146357 Sep 28 12:23:54.744217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 91/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:54 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:55.519740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:55.520875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:55.527083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.527556 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.527989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.528665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.529114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.529555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.654748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:55.662728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:55.664164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:55.665274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3dbfa4ad-202b-4317-8928-bf2f5885c6e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.149402 Sep 28 12:23:55.665831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 80/171] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:55 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:55.765674 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:55.766276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:55.772759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.773253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.773680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.774385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.774831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.775248 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.904754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:55.912507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-81834648-d952-4acb-b05a-5b7651a42ac0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.150582 Sep 28 12:23:55.913067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 92/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:55 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:56.689496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:56.690100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:56.696478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.696950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.697413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:56.698085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.698525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.698942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:56.826380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:56.834392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:56.835810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:56.836921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb3e54f1-4971-40be-8149-aeacb70c1b45 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.151249 Sep 28 12:23:56.837510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 81/173] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:56 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:56.934973 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:56.935574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:56.941399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.941815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.942400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:56.943591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.944038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.944453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:57.070267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:57.077790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e067d55-6369-4b51-8788-de6c40a48f55 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.146521 Sep 28 12:23:57.078344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 93/174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:56 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:57.861812 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:57.862442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:57.868869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:57.869384 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:57.869818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:57.870503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:57.870955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:57.871374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:58.004417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:58.013406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:58.015415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:58.016667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1ea5b940-7a2b-4213-941e-050ffad68414 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.158705 Sep 28 12:23:58.017533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 82/175] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:57 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:23:58.100069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:58.100673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:58.106485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:58.106962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:58.107386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:58.108057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:58.108504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:58.108917 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:58.238617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:58.246664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f9dd817e-b46d-4ab7-8034-c99e5c108d28 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.150844 Sep 28 12:23:58.247221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 94/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:58 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:23:59.042545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:59.043170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:59.048944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.049449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.049875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.050547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.051017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.051432 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.181867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:59.189808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:59.191238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:59.192361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb1484c0-626e-4b08-ac74-8e9de5beb83f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.153571 Sep 28 12:23:59.192909 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 83/177] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:23:59 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:23:59.270138 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:59.271574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:59.277495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.277971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.278392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.279071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.279516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.279929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.408670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:23:59.416363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6b7b94e1-62cd-44c7-931a-832779dfc72d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.150100 Sep 28 12:23:59.416945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 95/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:23:59 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:00.217443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:00.218598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:00.229921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.232403 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.232912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.233660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.234118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.234542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.384242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cf7cb87-8616-4813-bc85-6c8a14bd58e4"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:00.387025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:00.393562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.394069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.394485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.396606 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.397473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.398050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.422844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:00.431517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:00.432992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:00.439786 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-39de3a32-ce41-4641-958b-f246fd4afca5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.226025 Sep 28 12:24:00.440362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 84/179] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:00 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:00.448345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:00.453279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:00.477506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.477989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.478412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.479096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.479541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.479953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.627823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:00.635384 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-473c650b-22a3-4d9f-ac3a-fc22d9ed5391 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1366 microversion: 2.1 time: 0.194036 Sep 28 12:24:00.635951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 85/180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:00 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:01.468879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:01.471050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:01.481878 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.482679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.483449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.484767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.486056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.486940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.652876 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:01.663306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:01.665018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:01.666150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a3f41c78-4a66-4e74-819a-86cf880da2c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.203685 Sep 28 12:24:01.666697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 86/181] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:01 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:01.671528 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:01.672116 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:01.678188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.678659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.679264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.679946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.680385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.680795 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.832336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:01.842347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b6156148-cdee-45a3-b892-c4f9dbd19a29 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1556 microversion: 2.1 time: 0.174245 Sep 28 12:24:01.842916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 87/182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:01 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:01.872071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:01.873031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:01.882639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.883124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.883552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.884237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.884682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.885098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:02.021912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d3bcaab6-4826-4652-a19d-e10cfb9bf86c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154032 Sep 28 12:24:02.023079 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 88/183] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:24:01 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:02.623207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bc76a65d-2fcc-42d4-ade6-4c5e6c875778 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "POST /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.220732 Sep 28 12:24:02.626772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 96/184] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:24:00 2022] POST /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210/os-volume_attachments => generated 194 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:02.701653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:02.702246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:02.728824 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:02.729418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:02.729849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:02.730612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:02.731060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:02.731476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:03.072997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:03.086975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:03.089475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:03.091064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a4e37d67-13d2-4598-8ddc-ac7fa696b0da tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.395377 Sep 28 12:24:03.092583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 89/185] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:02 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:04.121060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:04.121980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:04.129099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:04.131123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f4d7a5-a42f-4ce7-bf29-b689265cceba", "tag": "7db57789-d5c3-4711-9222-79c5c2dd7daa"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:04.139463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:04.140877 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:04.142869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:04.143691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:04.144237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:04.144667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:04.144827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:04.146144 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:04.158756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] Creating event network-changed:7db57789-d5c3-4711-9222-79c5c2dd7daa for instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba on hv-cinder-84456 Sep 28 12:24:04.181930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-7e960e04-c42f-4bfb-8366-cbdb161ace36 req-560edfaf-bfc5-4c1b-a6c8-3f8fa468b7bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051529 Sep 28 12:24:04.183179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 90/186] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:04.464766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:04.480429 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:04.481907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:04.483006 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-27bea6bb-acfc-4e27-b577-a5661e286a8e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.367195 Sep 28 12:24:04.501423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 97/187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:04 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:05.526406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:05.527902 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:05.550299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:05.550803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:05.552123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:05.552967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:05.553510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:05.553972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:05.905040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:05.925864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:05.925864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:05.925864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77408791-6cb3-4270-8d92-f3e7f1be0010 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.401293 Sep 28 12:24:05.926385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 91/188] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:05 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:06.953521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:06.956279 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:06.968490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:06.969699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:06.971573 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:06.974335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:06.975033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:06.976378 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:07.190943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:07.208233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:07.215178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:07.218615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f9689d4c-ea20-4c90-ad86-125406dc1a96 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.275124 Sep 28 12:24:07.235792 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 98/189] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:06 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:08.247323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:08.250003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:08.261028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:08.269449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:08.272078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:08.273794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:08.274538 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:08.275069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:08.551394 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:08.559676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:08.561124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:08.568278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-999915b8-41be-4d7a-bd09-47f98febd63f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.326035 Sep 28 12:24:08.570940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 92/190] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:08 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:09.599685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:09.600237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:09.607445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:09.607935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:09.608371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:09.609125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:09.611157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "name": "network-vif-plugged", "status": "completed", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:09.612821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:09.613320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:09.635595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:09.636608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:09.637433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:09.655589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] Creating event network-vif-plugged:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:24:09.665555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-562533dc-7183-438e-b242-be26b43e5b50 req-2fc0133d-1905-4e2e-92b7-2f528a21497c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058708 Sep 28 12:24:09.666696 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 93/191] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:09.861381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:09.874924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:09.877690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:09.879838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f99336cd-9752-4731-bbc4-64537af17dcb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.285419 Sep 28 12:24:09.881766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 99/192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:09 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:10.909121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:10.909912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:10.916485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:10.916986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:10.917430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:10.918316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:10.918767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:10.919188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:11.054942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:11.064657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:11.068245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:11.070112 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4ea5e5a1-89a5-4b7d-9824-8daf0d0e18c2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.165360 Sep 28 12:24:11.070891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 94/193] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:10 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:12.095488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:12.097263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:12.105982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:12.107680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:12.108260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:12.109177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:12.109848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:12.110403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:12.372426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:12.402906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:12.408718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:12.414742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f200b064-8e1a-4048-952e-027c3e18ac99 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.320914 Sep 28 12:24:12.429214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 100/194] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:12 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:13.446101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:13.446814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:13.455663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:13.456146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:13.460555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:13.461642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:13.462262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:13.462842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:13.690281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:13.699601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:13.701071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:13.702242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-369771a6-b70e-4c56-80b7-38de5adae9ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.261401 Sep 28 12:24:13.714505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 95/195] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:13 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:14.732899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:14.734081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:14.745962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:14.746851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:14.747507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:14.748434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:14.749236 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:14.749871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:15.331396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:15.352353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:15.353847 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:15.354963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-95eb5968-e410-489e-aabe-417733fd1245 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.626974 Sep 28 12:24:15.367478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 101/196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:14 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:16.398494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:16.399143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:16.413160 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:16.413844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:16.414562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:16.415436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:16.416061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:16.416693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:16.681853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:16.697122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:16.698604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:16.699725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-56a3306f-d28f-4894-99e3-c1203852aebd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.315166 Sep 28 12:24:16.700293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 96/197] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:16 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:17.259794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c2545554-048f-4c12-aa28-3c414e89523a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Action: 'create', calling method: .version_select at 0x7fa706ee4160>, body: {"keypair": {"name": "tempest-TestShelveInstance-410200543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE2w/FcAgQcDFoSghYBkRlh69/mGwsh2iT+EQcnjWpA0WaW0w/wozvej2DOZtpNiPId3lzJzmr8OOwP7U3p9f1YfLeh4NPXSiselQI7R6pQ1gVdk4EMqUUcj8zyi2MkUg=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:17.279079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-c2545554-048f-4c12-aa28-3c414e89523a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Getting quotas for project 1f563e7675ef4d758e09e1a78b891c9d. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:17.284834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-c2545554-048f-4c12-aa28-3c414e89523a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Getting quotas for user 49280c781ba745aa83bf4c5db9359973 and project 1f563e7675ef4d758e09e1a78b891c9d. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:17.330437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c2545554-048f-4c12-aa28-3c414e89523a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.431896 Sep 28 12:24:17.341870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 102/198] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:24:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:17.514896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:17.516076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:17.530080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.533238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.536398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.540853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.541518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.544586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.596225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:24:17.619894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:17.731175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:17.732111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:17.745025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.747674 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.749057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.750729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.751381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.752982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.800854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-68cd7a7d-6cdb-4749-95d3-2564b0fb53cd tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 204 len: 0 microversion: 2.1 time: 0.291657 Sep 28 12:24:17.802530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 97/199] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:24:17 2022] DELETE /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:24:17.813846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:17.814894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:17.822961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.823940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.824645 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.825520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.826121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.826732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:18.134478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:18.155338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d85ca49f-7f31-4add-8697-7067b3870c28 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1554 microversion: 2.1 time: 0.347929 Sep 28 12:24:18.158884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 98/200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:17 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1554 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:18.273029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:18.290826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:18.293366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:18.294641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1fce9f8f-5405-4429-a93c-ecdd512eb635 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1405 microversion: 2.20 time: 0.568217 Sep 28 12:24:18.298736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 103/201] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:17 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1405 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:19.184405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:19.185203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:19.198117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.199272 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.199965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.201460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.202453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.203455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.327451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:19.329971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:19.349377 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.350310 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.351958 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.354502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.355169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.357844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.497200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:19.514418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eafb6dbd-0fef-4b36-8158-c847d39d751c tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1554 microversion: 2.1 time: 0.334347 Sep 28 12:24:19.515059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 99/202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:19 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1554 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:19.637701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:19.650735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:19.656000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:19.659297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-663eeb99-3741-4688-8335-d75937d9ed7f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1598 microversion: 2.20 time: 0.337010 Sep 28 12:24:19.660634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 104/203] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:19 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1598 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:19.690212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:19.690970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:19.698332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.698965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.699746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.700604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.701381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.702025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.815913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a0ba867e-5aa6-4041-bfb6-0d2b4a3d3f42 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130459 Sep 28 12:24:19.824282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 100/204] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 28 12:24:19 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:24:20.553647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:20.554533 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:20.566659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:20.572297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:20.572297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:20.578399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:20.578841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:20.579285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:21.678109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:21.697451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-daea437a-2833-48e4-b01c-7ddc878de2e1 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1554 microversion: 2.1 time: 1.147626 Sep 28 12:24:21.698418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 105/205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:20 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1554 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:22.686036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:22.692012 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:22.703996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f056349e-a0dd-4179-8cc2-2e3c77d54210", "name": "network-vif-deleted", "tag": "9aa52a1f-1b14-4e05-b50f-fcecfa618b5a"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:22.758549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:22.763903 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:22.765663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:22.775033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:22.777418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:22.779353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:22.821221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] Creating event network-changed:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:24:22.829301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] Creating event network-vif-deleted:9aa52a1f-1b14-4e05-b50f-fcecfa618b5a for instance f056349e-a0dd-4179-8cc2-2e3c77d54210 on hv-cinder-84456 Sep 28 12:24:22.842015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-c4dc6aaf-e263-4434-aa3a-3d4b52868919 req-e8a05c55-7008-48b8-80b9-90f293febb6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160227 Sep 28 12:24:22.842624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 101/206] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:22.844563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-a99b43a1-45d6-4398-8e13-a3bc060dedab req-fbc3d7ca-d710-49ae-a8b3-51f5b3dfc543 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143899 Sep 28 12:24:22.845668 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 106/207] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:22.858905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:22.868509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:22.879649 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:22.880436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:22.881768 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:22.883002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:22.886221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:22.887713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:23.038107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:23.059183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d38b6d8d-be19-4d95-b24e-c8985e59e9c3 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1346 microversion: 2.1 time: 0.215026 Sep 28 12:24:23.067690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 102/208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:22 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:24.092333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:24.093119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:24.137879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:24.138373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:24.144497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:24.146718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:24.151156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:24.151689 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:24.211106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:24.212134 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:24.212790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:24.215242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lazy-loading 'fault' on Instance uuid f056349e-a0dd-4179-8cc2-2e3c77d54210 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:24:24.228223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:24.383108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95575c3357d4413298c3fa08709c5037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afaa30b2f454bc0bf1f23ece426339b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:24.395223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b523598b-903f-4529-928c-4e3a7d220faa tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 200 len: 1351 microversion: 2.1 time: 0.307397 Sep 28 12:24:24.406403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 107/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:24 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 1351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:25.422243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:25.422811 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:25.438177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.438883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.439510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.442913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.445653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.446261 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.491158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] HTTP exception thrown: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Request method failure captured: Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 HTTP/1.1 Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyetvutGmeakfG8KIa1KotZUs3g1Gw76fNZcnsyK2owaRrmsOM51wAhWp8B75K1FxL8qp98403EGUUcHaI_5fCti9qM1Qt60oPpW03IdefDa6hbpA91ixzyGdax6a6WE41_gfV00Die9ksKl9V0DFaECW6rgXYG_DYgq1eSqAWMbro Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:24:25.504670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3afaa30b2f454bc0bf1f23ece426339b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}] Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 95575c3357d4413298c3fa08709c5037 Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.506289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'f056349e-a0dd-4179-8cc2-2e3c77d54210'} Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:24:25.507141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.509274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.510855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Returning 404 to user: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:24:25.510855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a3ebb06a-7be4-4d24-a224-3cb6ef0e6b66 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 404 len: 111 microversion: 2.1 time: 0.088526 Sep 28 12:24:25.512370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 103/210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:25 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:25.752616 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:25.755898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:25.770244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:25.772928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.773852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.774460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.775487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.776097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.776671 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.801610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] HTTP exception thrown: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Request method failure captured: Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210/os-volume_attachments HTTP/1.1 Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyetvutGmeakfG8KIa1KotZUs3g1Gw76fNZcnsyK2owaRrmsOM51wAhWp8B75K1FxL8qp98403EGUUcHaI_5fCti9qM1Qt60oPpW03IdefDa6hbpA91ixzyGdax6a6WE41_gfV00Die9ksKl9V0DFaECW6rgXYG_DYgq1eSqAWMbro Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:24:25.847346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3afaa30b2f454bc0bf1f23ece426339b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}] Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 95575c3357d4413298c3fa08709c5037 Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.848941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'server_id': 'f056349e-a0dd-4179-8cc2-2e3c77d54210'} Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:24:25.849766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:25.850988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:25.853613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Returning 404 to user: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:24:25.854638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1ac89d82-20c2-494a-ac35-00ca728fe38f tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.114133 Sep 28 12:24:25.859650 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 108/211] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:25 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210/os-volume_attachments => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:27.243074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:27.243684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:27.253892 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.254644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.255087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.261118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.264020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.264729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.297467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] HTTP exception thrown: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Request method failure captured: Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 HTTP/1.1 Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyetvutGmeakfG8KIa1KotZUs3g1Gw76fNZcnsyK2owaRrmsOM51wAhWp8B75K1FxL8qp98403EGUUcHaI_5fCti9qM1Qt60oPpW03IdefDa6hbpA91ixzyGdax6a6WE41_gfV00Die9ksKl9V0DFaECW6rgXYG_DYgq1eSqAWMbro Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:24:27.302922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3afaa30b2f454bc0bf1f23ece426339b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}] Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 95575c3357d4413298c3fa08709c5037 Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.304427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'f056349e-a0dd-4179-8cc2-2e3c77d54210'} Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:24:27.305269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.306545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.312208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Returning 404 to user: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:24:27.313091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d6a215bc-1bac-4a61-b0a7-2f19570eb781 tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 404 len: 111 microversion: 2.1 time: 0.074315 Sep 28 12:24:27.322890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:27.324911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] [instance: f056349e-a0dd-4179-8cc2-2e3c77d54210] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:27.332981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 104/212] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:24:27 2022] DELETE /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:27.335325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:27.339237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.340207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.342326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.343306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.344484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.346451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.387446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] HTTP exception thrown: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Request method failure captured: Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 HTTP/1.1 Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyetvutGmeakfG8KIa1KotZUs3g1Gw76fNZcnsyK2owaRrmsOM51wAhWp8B75K1FxL8qp98403EGUUcHaI_5fCti9qM1Qt60oPpW03IdefDa6hbpA91ixzyGdax6a6WE41_gfV00Die9ksKl9V0DFaECW6rgXYG_DYgq1eSqAWMbro Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:24:27.397575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3afaa30b2f454bc0bf1f23ece426339b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3afaa30b2f454bc0bf1f23ece426339b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3afaa30b2f454bc0bf1f23ece426339b"}]}] Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 3afaa30b2f454bc0bf1f23ece426339b Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-DeleteServersTestJSON-43286930 Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 95575c3357d4413298c3fa08709c5037 Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-DeleteServersTestJSON-43286930-project Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.399108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'f056349e-a0dd-4179-8cc2-2e3c77d54210'} Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:24:27.399949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. Sep 28 12:24:27.401185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:24:27.403020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] Returning 404 to user: Instance f056349e-a0dd-4179-8cc2-2e3c77d54210 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:24:27.404049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-76adbfc4-0cf9-48cb-8ce3-098b1564f3cb tempest-DeleteServersTestJSON-43286930 tempest-DeleteServersTestJSON-43286930-project] 10.222.0.60 "GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210" status: 404 len: 111 microversion: 2.1 time: 0.084953 Sep 28 12:24:27.405108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 109/213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:27 2022] GET /compute/v2.1/servers/f056349e-a0dd-4179-8cc2-2e3c77d54210 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:24:43.370848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=7 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:43.371567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:43.590429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1877621979", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:48.354111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2021042836", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-410200543", "security_groups": [{"name": "tempest-secgroup-smoke-23709153"}], "networks": [{"uuid": "0a527aef-dbda-440b-9928-2f1d09ae9cc3"}], "block_device_mapping_v2": [{"uuid": "1015fa6f-badf-4971-af5f-3c4b5a6cc4d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:48.373698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:48.383074 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:48.878799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] validate_networks() for [('0a527aef-dbda-440b-9928-2f1d09ae9cc3', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:24:49.824431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:24:49.825060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:24:49.825428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:24:49.828996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:24:49.829679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:24:49.842115 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.842603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.843026 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.843748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.844194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.844605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.891887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Getting quotas for project 1f563e7675ef4d758e09e1a78b891c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:49.901979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Getting quotas for user 49280c781ba745aa83bf4c5db9359973 and project 1f563e7675ef4d758e09e1a78b891c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:50.060909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:24:50.063257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1015fa6f-badf-4971-af5f-3c4b5a6cc4d5',volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:24:50.364801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-901ce086-174d-47e2-87a3-ea4a238e262b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.014921 Sep 28 12:24:50.365392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 110/214] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:24:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 12:24:50.377986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bd7c75cd-4b5b-462f-a533-988957c5c6ad tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:50.378706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bd7c75cd-4b5b-462f-a533-988957c5c6ad tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:50.560685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bd7c75cd-4b5b-462f-a533-988957c5c6ad tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:50.570423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bd7c75cd-4b5b-462f-a533-988957c5c6ad tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1088 microversion: 2.1 time: 0.196867 Sep 28 12:24:50.574492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 111/215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:50 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1088 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:51.058469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] validate_networks() for [('d22fae6b-c19d-4165-8f58-a67d0afa1461', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:24:51.593386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:51.594165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:51.607504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.610047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.610564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.612468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.613983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.615579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.727296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:51.748993 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:24:51.749803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:24:51.750590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:24:51.755821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:24:51.756575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:24:51.761261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8dc48c74-2401-4b25-8ad6-cfb3175f6e5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1130 microversion: 2.1 time: 0.169812 Sep 28 12:24:51.762435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 112/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:51 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1130 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:24:51.801413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.803367 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.804830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.806256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.806722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.813626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.833248 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:51.837807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for user cc96808ff3fb41f085f09aa943c3d016 and project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:51.851067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:24:51.853657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:24:51.927465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d4b5ae56-8f43-4082-8e69-b612a6725137 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.561884 Sep 28 12:24:51.928543 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 105/217] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:24:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 8563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:24:51.940934 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bacc44af-534e-4512-9c10-32375156f4d2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:51.941725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bacc44af-534e-4512-9c10-32375156f4d2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:52.117544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bacc44af-534e-4512-9c10-32375156f4d2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:52.125861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bacc44af-534e-4512-9c10-32375156f4d2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1222 microversion: 2.1 time: 0.190472 Sep 28 12:24:52.129531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 113/218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:51 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:52.353647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-664937843", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:52.511755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] validate_networks() for [('d22fae6b-c19d-4165-8f58-a67d0afa1461', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:24:52.829319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:52.831494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:52.862438 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.863148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.863849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.865553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.866168 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.866793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.974401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:52.986045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-48b65be2-15ba-4d02-b3d8-28d693c2d873 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1204 microversion: 2.1 time: 0.184688 Sep 28 12:24:52.987874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 114/219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:52 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1204 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:53.840422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:24:53.840934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:24:53.841607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:24:53.842143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:24:53.842664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:24:53.891036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:53.891567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:53.893879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:53.894752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:53.895271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:53.898401 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:53.943472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:53.948278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for user cc96808ff3fb41f085f09aa943c3d016 and project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:53.979520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:24:53.983639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:24:54.020263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:54.021072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:54.035701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.036193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.036622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.037639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.042802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.043735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.085862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-150ccc1d-66bf-44f0-985c-5f5f095ae97c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.733635 Sep 28 12:24:54.093835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 106/220] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:24:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:24:54.114229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bfddd42d-bb5a-4aeb-8e6c-8dc52ac41b84 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:54.116275 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bfddd42d-bb5a-4aeb-8e6c-8dc52ac41b84 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:54.227937 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:54.240265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-aeb166b9-f501-45eb-bd7f-7450d7416cd5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1204 microversion: 2.1 time: 0.225139 Sep 28 12:24:54.257053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 115/221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:54 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1204 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:24:54.293901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bfddd42d-bb5a-4aeb-8e6c-8dc52ac41b84 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:54.341163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bfddd42d-bb5a-4aeb-8e6c-8dc52ac41b84 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1221 microversion: 2.1 time: 0.242166 Sep 28 12:24:54.341750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 107/222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:54 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:24:55.273821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:55.274302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:55.286711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.290518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.290996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.293459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.293950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.294382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.370735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:55.371386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:55.387405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.387951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.389562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.390257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.390746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.396472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.528072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:55.539537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3400ba72-3125-436c-8270-5763ff3a9154 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1217 microversion: 2.1 time: 0.172845 Sep 28 12:24:55.559637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 108/223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:55 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:55.679296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:55.692007 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e4954e65-b980-4792-8b57-bd7d4b624b80 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.427902 Sep 28 12:24:55.692585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 116/224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:55 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:56.568335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:56.569756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:56.580857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.587461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.587974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.588718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.589206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.589883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.725433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:56.726031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:56.734012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.734502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.735000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.735643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.736098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.737070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.917331 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:56.931325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a01d9398-3f65-4f85-8572-1b2dc4af82f0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1281 microversion: 2.1 time: 0.367342 Sep 28 12:24:56.952897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 109/225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:56 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1281 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:57.096416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:57.112021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-01988502-dddd-4da7-8ab3-7a27c45b9ae9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.399585 Sep 28 12:24:57.113002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 117/226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:56 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:57.177118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:57.193835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.206560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.207008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.224024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] Creating event network-changed:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:24:57.232810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-f67200f4-ac6c-4a73-824c-683a3d96801f req-d23770cd-eea0-4063-a89e-4b7db1691741 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061572 Sep 28 12:24:57.237875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 110/227] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:57.960170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:57.961476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:57.975521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.976187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.980346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.981313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.983317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.984177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.135885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:58.137271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:58.148613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.149104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.151398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.153104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.160656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.161111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.601743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.614485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ef807265-5461-46a1-a1e7-deadc6847a97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.482602 Sep 28 12:24:58.615084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 111/228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:58 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:58.679515 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.707345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c74bf584-089e-44bd-83dc-8a70185c90bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.750006 Sep 28 12:24:58.733433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 118/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:57 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:59.291641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b649038-e0a8-45a6-a118-534dcc182549", "tag": "09e1cefa-c541-48a1-923b-e5aa1c92ec8c"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:59.314026 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.317970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.319763 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.355500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] Creating event network-changed:09e1cefa-c541-48a1-923b-e5aa1c92ec8c for instance 2b649038-e0a8-45a6-a118-534dcc182549 on hv-cinder-84456 Sep 28 12:24:59.371906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-ee1b1ffd-90a8-4614-a8ec-35c613b63e43 req-bc5f575d-c58e-4ffc-807a-92a8e00fdbc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085910 Sep 28 12:24:59.380070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 112/230] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:59.646941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:59.648662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:59.655486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.655914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.656723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.657943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.658827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.659748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.740737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:59.741761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:59.753928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.754747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.757907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.759242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.760290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.761386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.869692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:59.914158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:59.923054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4a0fc54a-feff-4d85-8e54-2204003c3dfe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.285431 Sep 28 12:24:59.938387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:59 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:59.945514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-32838262-82c3-4524-926d-8f396227705c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'create', calling method: .version_select at 0x7fa706d87b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-209561139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbVht5sMRkTY21hDpPvY+iUwGt35X12wFdttAxat/NR3TzHy/ThK2CCg171pDDkXlRhLq6kzvJophPLLS0Pzc2hC/7CdWcZG3k7tX4fRrYabgcpyd0Ys0pviTb6MuiMSg=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:59.962902 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-32838262-82c3-4524-926d-8f396227705c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Getting quotas for project 19f9f5faf55a4b0cb17bf36d8cb838f6. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:59.968249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-32838262-82c3-4524-926d-8f396227705c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Getting quotas for user 2ab18214df00412bb7440535ac725056 and project 19f9f5faf55a4b0cb17bf36d8cb838f6. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:00.000687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-32838262-82c3-4524-926d-8f396227705c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061386 Sep 28 12:25:00.001644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 120/232] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:24:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:00.030880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:00.043577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f074e1c5-208b-41e0-bd55-a17eb0126480 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.307472 Sep 28 12:25:00.058560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 113/233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:59 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:00.199128 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1985481267", "imageRef": "e6a26ece-50bb-48d5-9d0d-6f3c1ec92a35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-209561139", "networks": [{"uuid": "8fd9a966-848a-4a04-aad9-4eacaa03d7c2"}]}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:00.307738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] validate_networks() for [('8fd9a966-848a-4a04-aad9-4eacaa03d7c2', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:25:00.948613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:00.949312 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:00.959853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.960446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.965757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.966623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.967105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.967530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.327467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:01.343357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-25eeee77-8dfe-4fca-8b77-d3917516cea5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.394455 Sep 28 12:25:01.344403 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 114/234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:00 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:01.369003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.370056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.384088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.387083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.389402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.391412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.392255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.394732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.437624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:25:01.438207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:25:01.439062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:25:01.439177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:25:01.440276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:25:01.456866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.457386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.457816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.458591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.458983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.459402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.497946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Getting quotas for project 19f9f5faf55a4b0cb17bf36d8cb838f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:01.503747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Getting quotas for user 2ab18214df00412bb7440535ac725056 and project 19f9f5faf55a4b0cb17bf36d8cb838f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:01.518332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:25:01.522561 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6a26ece-50bb-48d5-9d0d-6f3c1ec92a35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:25:01.609524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-06940061-18bb-43fd-8d4d-717865e44be1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420688 Sep 28 12:25:01.618551 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 121/235] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:25:01.632031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f1dd656f-79db-4d95-bd69-0da7a4e964ad tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.632767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f1dd656f-79db-4d95-bd69-0da7a4e964ad tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.831405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:01.843272 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d9b1866d-0184-47bf-92d5-165215e73163 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.483554 Sep 28 12:25:01.861156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 115/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:01.895192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f1dd656f-79db-4d95-bd69-0da7a4e964ad tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:01.910556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f1dd656f-79db-4d95-bd69-0da7a4e964ad tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1258 microversion: 2.1 time: 0.290856 Sep 28 12:25:01.911151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 122/237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1258 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:02.252547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef4ea58-06f0-4031-a8a0-16d8be1614cb", "tag": "a78a4209-5195-4106-9e3b-df3a33a1b706"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:02.274506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.275175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.275895 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.290361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] Creating event network-changed:a78a4209-5195-4106-9e3b-df3a33a1b706 for instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb on hv-cinder-84456 Sep 28 12:25:02.309120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b1120a88-22ed-4551-ab66-055d4a89aebf req-b25ae384-36ce-4140-953b-eb5cbc3bf914 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061566 Sep 28 12:25:02.310019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 116/238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:02.375058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.376336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.396344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.398443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.400470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.403200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.405056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.405481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.563703 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.579335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fb6fe4d9-2e68-4b5c-8d09-ba12c24d05b8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.209643 Sep 28 12:25:02.579335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 123/239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:02.873821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.874597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.881739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.882225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.882661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.883468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.883920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.884458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.937721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.938786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.946229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.946756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.947185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.948505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.950362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.951069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.041956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.053165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ea4cc8fb-48e1-4cc1-bd8f-ffdbb1c05d70 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1262 microversion: 2.1 time: 0.118102 Sep 28 12:25:03.053165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 124/240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:03.060245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.069549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c0d50bb8-c809-40d0-b56d-d3d1849ce165 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.199953 Sep 28 12:25:03.070358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:03.604907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:03.605763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:03.613374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.613964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.614592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.615818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.616342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.616781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.762460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.773181 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-624cf603-1994-4cf9-bbdf-0e7341f2910d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.173086 Sep 28 12:25:03.773817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 125/242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:03 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:04.074223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.074894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.077318 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:04.083663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.084405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.084834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.085837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.086407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.087306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.095668 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.096592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.103747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.104233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.104669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.105436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.105844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.106275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.169664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.178187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c44e0ebc-4c79-406a-a60e-3703ec4cab36 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1262 microversion: 2.1 time: 0.107871 Sep 28 12:25:04.185166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 118/243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1262 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:04.256527 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.265001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f43c882f-5510-459f-bf87-a8d4cb6b56a9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.175239 Sep 28 12:25:04.265683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 126/244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:04.795730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.796388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.798438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=14 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:04.804374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.806721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.807201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.807951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.808832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.954157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.963517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38cc9445-7af4-44f1-92af-5e307a2d0c61 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.171566 Sep 28 12:25:04.964093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 119/245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:05.208505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:05.209065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:05.215895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.216379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.217023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.217969 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.218785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.219209 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.291133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:05.291860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:05.311650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.312164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.312832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.313625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.314241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.314671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.339166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:05.352167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-51318e89-7b73-48a4-b4ef-5e85d8763779 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1262 microversion: 2.1 time: 0.147752 Sep 28 12:25:05.355645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 127/246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:05 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:05.498133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:05.506669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5f148f38-8ee9-481b-b5ea-996c83ce8fa2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.222816 Sep 28 12:25:05.507253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:05 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:05.986729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:05.987343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:05.998621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.999195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.999759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.000527 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.000997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.001520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.164757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:06.172746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8be08cb4-8ce8-4fb9-98f3-6199168a38a3 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.189841 Sep 28 12:25:06.173367 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 128/248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:05 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:06.381543 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:06.382162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:06.388063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.388541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.388965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.389691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.390140 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.390554 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.456497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:06.464264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-62c0a381-438b-415f-8cd4-7bed1f4fe9f1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.087572 Sep 28 12:25:06.464830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 121/249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:06 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:06.531522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:06.532317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:06.540848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.541466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.541901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.542627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.543070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.543502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.716383 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:06.724721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a95f9d51-3903-4a01-a568-b1c5232d6fd8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.197667 Sep 28 12:25:06.725325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 129/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:06 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:07.195289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.197730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.211672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.212681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.214970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.217343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.218321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.219043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.428433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.442395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0492d288-6745-4866-a70e-42d7e34116cf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.251510 Sep 28 12:25:07.443317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 122/251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:07.447397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b649038-e0a8-45a6-a118-534dcc182549", "name": "network-vif-plugged", "status": "completed", "tag": "09e1cefa-c541-48a1-923b-e5aa1c92ec8c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:07.464784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.465382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.465853 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.479417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] Creating event network-vif-plugged:09e1cefa-c541-48a1-923b-e5aa1c92ec8c for instance 2b649038-e0a8-45a6-a118-534dcc182549 on hv-cinder-84456 Sep 28 12:25:07.486715 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-82f83164-f3c2-437f-bfe5-0d603d6e9e0c req-9883fead-f208-42d9-a886-d91d411ee26d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044538 Sep 28 12:25:07.487432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 130/252] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:07.493729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.494630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.500709 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.501344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.502232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.503101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.504280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.504704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.575092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.584183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0605950c-9270-4a73-b28e-0b487cd237cb tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.098238 Sep 28 12:25:07.584760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 123/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:07.748776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.749692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.755942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.756498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.756997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.757775 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.758380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.758862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.903821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.912889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3238b477-07df-47fb-988a-8a2d8c8c5c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.168792 Sep 28 12:25:07.913685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 131/254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:08.465962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:08.466703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:08.472693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.473205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.473789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.474553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.475040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.475471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.608114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:08.608805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:08.616425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.617448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.618295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.619194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.619908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.620271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.620678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:08.631530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d7040810-bad6-451e-a7f1-5fbd8f18bee4 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.168460 Sep 28 12:25:08.632122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 124/255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:08.639579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:08.683954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:08.692215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1778eb7d-d517-4ef1-9849-4c4402835e8a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.087990 Sep 28 12:25:08.695362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 132/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:08.935885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:08.936496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:08.943125 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.943616 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.944054 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.944743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.945404 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.945906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.098188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:09.101878 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:09.107159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1ae80bd5-dcc8-4610-b688-15426f7d4e45 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.175211 Sep 28 12:25:09.107814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 125/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:09.658435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:09.659032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:09.665751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.666233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.666664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.667358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.667807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.668232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.717164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:09.723025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:09.729185 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.729667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.730092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.730776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.731219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.731636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.794471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:09.802309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-af4c624d-c024-4ec3-9857-55e8a0fbe951 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.088898 Sep 28 12:25:09.802906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 126/258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:09 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:09.807514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:09.815182 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-58083112-3cc3-4222-b554-79bd618d043e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.160659 Sep 28 12:25:09.816247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 133/259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:09 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:10.131539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.132184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.138106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.138588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.139022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.139711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.140160 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.140579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.281539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:10.290504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-52589303-b31f-46ea-9a62-1200a516eda3 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.163840 Sep 28 12:25:10.291079 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 127/260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:10 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:10.825820 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.826423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.833475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.833955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.834382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.835063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.835507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.835922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.838368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.839117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.845189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.848253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.848253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.848253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.848253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.848766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.902508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:10.910912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6d56b193-e238-4898-85ed-6bf7f6a8760d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.088853 Sep 28 12:25:10.911492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 134/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:10 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:10.990916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:10.998774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2454059a-ee28-4544-8098-839eaffacd20 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.164301 Sep 28 12:25:10.999343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 128/262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:10 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:11.316806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:11.317667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:11.320559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:11.324423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.324906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.325365 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.326055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.326525 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.326940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.459911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:11.467431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-eba6f179-b3e1-4eda-adb3-afcf7e2e7190 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.155071 Sep 28 12:25:11.467995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 135/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:11 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:11.934101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:11.934725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:11.940501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.941020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.941510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.942190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.942632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.943044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.002815 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:12.010480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3878430-f7d2-4f81-891c-b50e90369bc7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.080319 Sep 28 12:25:12.011034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 129/264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:11 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:12.021318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:12.021983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:12.023761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:12.024863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=22 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:12.030568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.031050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.031485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.032169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.032624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.033046 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.165512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:12.173688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-82ed6049-2b00-483c-a68d-8b15c4d83e7f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.156025 Sep 28 12:25:12.174073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 136/265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:12 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:12.490191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:12.490820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:12.496621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.497101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.497563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.498240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.498692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.499109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.628912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:12.636482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d89ed503-4ab7-4f25-9fbc-b87e2f8e2523 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.150071 Sep 28 12:25:12.637043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 130/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:12 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:13.033235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.033846 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.040143 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.040622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.041059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.041770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.042226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.042646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.101562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:13.108967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-393f398c-07d3-4e47-94b2-632015c0c916 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.079525 Sep 28 12:25:13.109581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 137/267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:13.196474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.197076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.202722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.203199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.203627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.204347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.204793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.205230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.335910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:13.343584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-09625d05-75ad-4947-bccd-1d73207e38d8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.151046 Sep 28 12:25:13.344154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 131/268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:13.659770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.660435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.667295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.667791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.668233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.668943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.669435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.669863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.802931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:13.811191 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d1a0ed48-6d9c-4bad-99f8-e4236cc3b9e4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.155344 Sep 28 12:25:13.811798 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 138/269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:14.132370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:14.133020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:14.135123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:14.140187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.140666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.141090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.141813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.142255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.142667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.204293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:14.212567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a34fc228-ee5c-4794-bf8b-800a7af7a35e tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.084623 Sep 28 12:25:14.213145 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 132/270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:14 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:14.366537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:14.367085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:14.373595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.374077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.374510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.375203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.375646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.376062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.508137 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:14.515610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-510f0370-e9c6-4063-add9-a60aa1e81301 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.153514 Sep 28 12:25:14.516176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 139/271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:14 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:14.835152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:14.835753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:14.841712 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.842187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.842619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.843298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.843858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.844284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.975180 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:14.982779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ccdc9a91-48fb-4042-85fb-3626a5c25c20 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.151556 Sep 28 12:25:14.983341 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:14 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:15.235022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:15.235630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:15.242710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.243200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.243642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.244348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.244805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.245258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.308612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:15.320564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a8f4a7a5-242a-4843-b9ee-d7d3ddcc5e3c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.089260 Sep 28 12:25:15.321230 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 140/273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:15 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:15.541493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:15.542149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:15.547980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.548465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.548902 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.549722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.550060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.550484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.682117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:15.689683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-50f6bb32-ebd6-4f36-b880-b73e92d8cdb9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.156397 Sep 28 12:25:15.690243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 134/274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:15 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:16.006926 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.007546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.014106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.014584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.015016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.015708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.016159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.016575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.147733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:16.155250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5c3734b9-2be6-4e21-a584-ff761c2b102c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.152775 Sep 28 12:25:16.155814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 141/275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:16.343767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.344381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.351547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.352037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.352478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.353209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.353677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.354091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.413891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:16.421393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6c3c1cc4-247d-4790-847a-ddf0169211f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.081381 Sep 28 12:25:16.421957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 135/276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:16.713303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.713911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.719821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.720303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.720737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.721447 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.721903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.722605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.848758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:16.856976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-54c7f5f0-403a-4a73-ab73-11ad4cbb0471 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.147979 Sep 28 12:25:16.857558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 142/277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:17.178735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.181089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.187109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.187610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.188035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.188715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.189187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.189605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.321562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:17.329072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c67b993-b151-4be5-b52e-4cee92e55a1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.154231 Sep 28 12:25:17.329660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 136/278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:17.445750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.447420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.454114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.454610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.455055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.455758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.456212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.456636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.517257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:17.524747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1599e5c9-84a3-4367-8f92-84bbec8e4d7a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.083748 Sep 28 12:25:17.525350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 143/279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:17.879752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.880357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.886833 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.887311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.887741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.888427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.888884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.889324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.018310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:18.026419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-29748b1e-d351-467c-aa08-213da041fde0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.150511 Sep 28 12:25:18.026985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 137/280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:18.352737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:18.353359 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:18.359211 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.359685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.360114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.360797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.361274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.361692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.496072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:18.496072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a5be3647-6692-4b5e-a06c-3b427aacb277 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.147501 Sep 28 12:25:18.496839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 144/281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:18 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:18.547657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:18.548266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:18.554323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.554804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.555237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.555918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.556425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.556848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.619890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:18.628110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ff270ae5-4823-4952-bfff-e5ee74e3f4a6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1254 microversion: 2.1 time: 0.084234 Sep 28 12:25:18.628686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 138/282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:18 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:19.049715 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.050355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.057253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.057744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.058181 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.058887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.059337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.059761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.199958 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:19.207834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a6bcb067-45d4-41e8-afa8-feb561aa545d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.162154 Sep 28 12:25:19.208399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 145/283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:19.519427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.520029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.526859 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.527352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.527782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.528485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.528932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.529381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.652603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.653222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.659671 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.660161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.660598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.660770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:19.661320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.661779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.662814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.668983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cd814e24-46ad-4433-bd5d-9532dff168ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.153421 Sep 28 12:25:19.669588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 139/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:19.723018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:19.731177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-54005b41-324d-4aad-843f-84a5cd5263ca tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1310 microversion: 2.1 time: 0.082521 Sep 28 12:25:19.731744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 146/285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:20.230600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:20.231204 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:20.237296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.237807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.238250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.238936 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.239393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.239851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.372549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:20.380189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24f4bbf5-e772-4377-83fc-ebdc0ca303a9 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.153564 Sep 28 12:25:20.381413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 140/286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:20 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:20.691779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:20.692415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:20.698982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.699463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.699905 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.700630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.701101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.701549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.753997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:20.754632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:20.760679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.761186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.761630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.762309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.762778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.763177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.824461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:20.831486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:20.832011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e2ba275-29f0-492b-bde4-a993447682b9 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1310 microversion: 2.1 time: 0.081839 Sep 28 12:25:20.832584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 141/287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:20 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:20.839680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d9cb7eb0-8722-445f-94da-f686a8124547 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.151815 Sep 28 12:25:20.840235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 147/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:20 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:21.403656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:21.404438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:21.410660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.411242 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.411948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.412894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.413465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.414086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.434570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:21.598113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:21.608515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aa194e1d-4cac-4098-8ed3-69028e0a9ae7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.209050 Sep 28 12:25:21.609300 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 142/289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:21 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:21.855376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:21.856017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:21.862517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.862996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.863183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:21.863596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.863787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:21.864236 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.864724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.865838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.871750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.871750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.871750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.872056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.872516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.872937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.932351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:21.939797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7e98c606-63c6-40dd-8331-9d6140b946b4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1310 microversion: 2.1 time: 0.088260 Sep 28 12:25:21.940356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 148/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:21 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:22.025163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:22.032759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4433cb6-c2f0-4869-9356-555996d99416 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.173372 Sep 28 12:25:22.033357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 143/291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:21 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:22.632341 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:22.632951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:22.638989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.639468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.639899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.640590 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.641043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.641497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.645365 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:22.779229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:22.789285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6013bd8b-51be-4fcb-b28e-d9530348c52b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.161800 Sep 28 12:25:22.789845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 149/292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:22 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:22.965667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:22.966287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:22.972945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.973374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.973808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.974511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.975413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.975413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.037843 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:23.046652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c15a0922-fb64-43a3-bfe6-cacdf7236446 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1310 microversion: 2.1 time: 0.085027 Sep 28 12:25:23.047410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 144/293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:22 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:23.064810 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:23.065448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:23.071839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.072320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.072755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.073461 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.073910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.074325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.205418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:23.213414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-10a07949-1dde-4a62-a3e1-8a034ac3a2c5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.161530 Sep 28 12:25:23.213974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 150/294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:23 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:23.816233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:23.817095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:23.826103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.826586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.827031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.827692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.828130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.828548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.070474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:24.071096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:24.080066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.080562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.081010 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.081761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.082226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.082656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.142358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:24.154102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb817af3-ee47-4376-aca3-0f7dead5ec9a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.345134 Sep 28 12:25:24.156720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 145/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:23 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:24.175717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "name": "network-vif-plugged", "status": "completed", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:24.191429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.192212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.193666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.213552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] Creating event network-vif-plugged:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:25:24.220536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-ea478ce2-6674-4b7a-9866-aadb2cf7ab34 req-39f6ccb0-4e9d-40ef-bd75-81641c6b18c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061708 Sep 28 12:25:24.221977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 146/296] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:24.237805 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:24.238033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:24.238510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:24.246025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.246515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.247014 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.247723 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.248281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.248600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.249667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-da3898f2-4f7c-4ea4-b8d7-6a4154472742 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1318 microversion: 2.1 time: 0.183567 Sep 28 12:25:24.251493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 151/297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:24 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:24.423268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:24.432618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a27014e-eaaa-4ad6-8176-84e772c50c94 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.199501 Sep 28 12:25:24.433419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 147/298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:24 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:25.184514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:25.184514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:25.191777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.192494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.193637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.195268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.195935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.196608 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.286188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:25.287454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:25.305497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.308255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.308720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.309468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.310109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.312939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.416655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:25.423576 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:25.424400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7538fb63-0e08-4fe0-8b2d-43c6c1e53800 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1316 microversion: 2.1 time: 0.146564 Sep 28 12:25:25.425032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 148/299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:25 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:25.438038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-41e2b98c-24cb-4b41-9697-adb03dbd786a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.261769 Sep 28 12:25:25.439911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:25 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:25.461564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:25.462408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:25.469401 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.470092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.470684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.471555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.472410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.472981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.694166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:25.702886 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2e82b446-513b-4d28-a901-c469d3f75a8b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.248484 Sep 28 12:25:25.703857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 149/301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:25 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:26.448475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:26.449318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:26.456154 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.456889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.457502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.458510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.459265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.459726 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.467382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:26.468785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:26.481284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.481785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.482227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.482969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.483421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.483847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.663040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:26.671563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:26.671901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d6167bfb-1863-4dca-b397-7ac2b62bbba1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.208252 Sep 28 12:25:26.673087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 150/302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:26 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:26.681534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d3693044-3916-4bcc-87d2-a8e75911ce24 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.236959 Sep 28 12:25:26.682295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 153/303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:26 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:26.723691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef4ea58-06f0-4031-a8a0-16d8be1614cb", "name": "network-vif-plugged", "status": "completed", "tag": "a78a4209-5195-4106-9e3b-df3a33a1b706"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:26.728362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:26.729197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:26.734184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.734869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.735455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.735716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.736233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.736675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.737399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.738194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.738626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.747994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] Creating event network-vif-plugged:a78a4209-5195-4106-9e3b-df3a33a1b706 for instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb on hv-cinder-84456 Sep 28 12:25:26.752788 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-58ac43a3-becf-48fa-8167-6d92675d57ff req-13ac1d59-18dc-4c06-8c23-7c3158dbe7ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033102 Sep 28 12:25:26.753445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 151/304] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:26.893709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:26.905804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-18c44360-cdbf-471a-b79a-fecda160c7c7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.182337 Sep 28 12:25:26.920645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 154/305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:26 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:27.698136 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:27.698951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:27.704694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:27.705340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.705836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:27.706317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:27.706425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:27.707052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.707665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:27.708083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:27.716447 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.716951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:27.717424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:27.718133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.718592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:27.719016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:27.912007 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:27.920039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4aba751-9590-493d-aa03-fcfe3670c8c0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.225784 Sep 28 12:25:27.952328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 152/306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:27 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:27.956903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:27.972947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2eb03a31-d43e-4414-80fc-2b1d15fa61f8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.272071 Sep 28 12:25:27.973656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 155/307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:27 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:27.975033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:27.975636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:27.995143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.995992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:27.996652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:27.997785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:27.999246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.000088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.091450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1195806930", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:28.172095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] validate_networks() for None {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:25:28.214844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:28.225491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3f9839c1-e63d-4b2c-b73e-6ae3f4d9d8ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.262892 Sep 28 12:25:28.226585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 153/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:27 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:28.526591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:25:28.527112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:25:28.527599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:25:28.528015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:25:28.528429 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:25:28.538417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.539118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.539555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.540287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.540748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.541194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.558781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Getting quotas for project 14944124ab8a4487b879592a02981d12. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:28.563331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Getting quotas for user d12d46f42d73486fbbc3a1c2df0f3ab9 and project 14944124ab8a4487b879592a02981d12. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:28.578010 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:25:28.580312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:25:28.629865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b9338fdf-6189-4c49-80bc-4f962b0a8ea4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543379 Sep 28 12:25:28.630699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 156/309] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 12:25:28.641657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-706a7a65-b81a-4f1a-be89-5c4db7eae5b4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:28.642268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-706a7a65-b81a-4f1a-be89-5c4db7eae5b4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:28.714090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-706a7a65-b81a-4f1a-be89-5c4db7eae5b4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:28.727801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-706a7a65-b81a-4f1a-be89-5c4db7eae5b4 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1215 microversion: 2.1 time: 0.089566 Sep 28 12:25:28.730344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 154/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:28 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:28.952885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:28.954210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:28.963999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.964415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.964847 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.965578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.966057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.966599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.006148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:29.007666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:29.019871 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.020599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.023498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.024431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.025052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.025783 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.258879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:29.281381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d8a763bf-c775-4a3e-a751-748dc615a80a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.328305 Sep 28 12:25:29.281381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 157/311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:28 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:29.291006 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:29.291610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:29.307690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.308705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.309169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.311639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:29.319584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.320088 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.320950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0502153e-f48f-48ee-8a2c-13be908e6349 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.328606 Sep 28 12:25:29.321558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 155/312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:28 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:29.324288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.482327 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:29.497084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7077b895-a36e-4728-923e-518924e44d5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.217833 Sep 28 12:25:29.498455 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 158/313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:29 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:29.754313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:29.757619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:29.766389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.767298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.768055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.768864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.769600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.770036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.866802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:29.876308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-55d8bdfd-31ea-45e1-8697-e9412ce0dafa tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.127847 Sep 28 12:25:29.877060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 156/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:29 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:30.304344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:30.305098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:30.311467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.312025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.312466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.313260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.313629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.314063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.346913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:30.348158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:30.356752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.359494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.360303 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.361329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.362106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.362899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.548400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:30.568420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-32c335dd-5f15-4d76-a62b-10e2f0c8eed8 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.227264 Sep 28 12:25:30.569976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 157/315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:30 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:30.574504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:30.585697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:30.592050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.592537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.592965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.593686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.594132 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.594549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.675675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:30.686754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a0ac0ffb-2686-4589-92ec-f95ace284af6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.386301 Sep 28 12:25:30.689051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 159/316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:30 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:30.775039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:30.783423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aa2f7ea6-06e3-46e5-bfda-ca056d198bcb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.212075 Sep 28 12:25:30.784483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 158/317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:30 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:30.901748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:30.902351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:30.908496 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.908985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.909456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.910157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.910612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.911036 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.980312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:30.988854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d5b49623-e0c6-4de8-b25c-b034a794b707 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.090226 Sep 28 12:25:30.988854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 160/318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:30 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:31.594706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:31.595227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:31.602059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.602538 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.602966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.603647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.604217 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.604678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.712688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:31.713435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:31.720027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.721071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.721071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.721697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.722410 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.722835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.743829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:31.751937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4b2328d8-640d-42bf-bd8b-8a1a6621830c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.160897 Sep 28 12:25:31.752697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 159/319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:31 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:31.808076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:31.808749 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:31.814886 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.815371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.815796 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.816659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.817113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.817589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.875578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:31.885478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-99167a18-88e2-44f4-95cc-cf9f99891bd1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.177427 Sep 28 12:25:31.886162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 161/320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:31 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:31.984056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:31.991477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2ddcbe4b-a4c2-4b39-b84b-c88960c2e233 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.187352 Sep 28 12:25:32.005972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 160/321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:31 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:32.019312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:32.020010 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:32.043151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.043552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.043994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.044700 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.045169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.045593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.491994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:32.506980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5ea8b64b-8d70-4c37-a539-f3c0744172d6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.498193 Sep 28 12:25:32.507498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 162/322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:32 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:32.775139 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:32.775995 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:32.783076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.783558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.783984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.784675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.785121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.785568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.806565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:32.910910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:32.912070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:32.922227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.922858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.923328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.924045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.929318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.930165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.003282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:33.015259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-35881ec6-f3c1-4c53-a527-6ec8db1a5ddc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.243849 Sep 28 12:25:33.033076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 161/323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:32 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:33.040071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:33.041081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:33.048062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.048916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.049864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.050807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.051400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.054083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.182595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:33.194211 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-93208fad-afc5-4d1d-bae1-d5dd5e6b0cbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.287544 Sep 28 12:25:33.209158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 163/324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:32 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:33.247904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:33.257355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-679a6de1-2a97-44a1-9436-d4c4b217af47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.221991 Sep 28 12:25:33.258644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 162/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:33 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:33.529934 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:33.530549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:33.543769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.544986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.546711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.548393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.549181 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.550149 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.632954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:33.642256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0785679e-90f2-4923-8686-d376fa7d6890 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.116042 Sep 28 12:25:33.643402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 164/326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:33 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:34.040342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:34.040962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:34.051636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.052779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.054792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.056325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.057601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.060059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.225750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:34.227416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:34.234330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:34.247299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0862cb3c-83bd-48d9-b5be-9c5c7c5cbbbd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.211655 Sep 28 12:25:34.252577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.253059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.253518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.254216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.254662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.255170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.256776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 163/327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:34 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:34.281950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:34.282553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:34.289894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.290379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.290994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.292190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.292789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.293396 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.511848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:34.526725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b961c7a2-8096-49cb-a549-19e2398d0519 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.249194 Sep 28 12:25:34.527607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 164/328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:34 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:34.565597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:34.573883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0ba199a0-b120-4285-a0c2-7ba766528d18 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.357319 Sep 28 12:25:34.574508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 165/329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:34 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:34.667550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:34.668250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:34.680006 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.680861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.681684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.682585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.683532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.684698 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.957571 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:34.968581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-30a2da34-0944-4ffb-930a-8a366ba666b8 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.304775 Sep 28 12:25:34.969943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:34 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:35.293303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:35.301275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:35.333250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.340485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.342562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.350038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.383926 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.385061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.451132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:35.555801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:35.556413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:35.565724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.566640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.567121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.568908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.571748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.574929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.620200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:35.629360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4949c939-6905-4088-b9ac-cdb8f6e11210 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.345327 Sep 28 12:25:35.630793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:35 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:35.636043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:35.636965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:35.643459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.643958 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.644380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.645156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.646320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.646923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.765919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:35.777676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-192e8b67-e998-44e1-a9ae-46b052a042ca tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.227090 Sep 28 12:25:35.778827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 166/332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:35 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:35.857637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:35.865761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-280b77b5-312f-42b3-9661-5087c5ab0e0c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.233638 Sep 28 12:25:35.866332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 167/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:35 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:35.992155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:35.992753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:35.999042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.999570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.000007 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.000717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.001199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.001623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.064047 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:36.072491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-89a47ad6-89ed-4af6-b3f7-eee40a8344bc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.084481 Sep 28 12:25:36.073100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 167/334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:35 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:36.657540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:36.658173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:36.664991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.665505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.665941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.666626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.667075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.667494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.803750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:36.805462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:36.807923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:36.811716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.812195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.812624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.813355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.813772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.814364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.817291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-22b40b11-6b15-49ad-b339-dcc3a09d2139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.163414 Sep 28 12:25:36.818821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 168/335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:36 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:36.890388 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:36.891124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:36.899499 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.900001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.900648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.901584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.902055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.902526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.977019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:36.986644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a03dd029-f6e4-4377-87e4-37e3a094f1ec tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.187968 Sep 28 12:25:36.987380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 168/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:36 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:37.047821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:37.056657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-72d5517f-c089-4388-b380-831e49cdbd97 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.170522 Sep 28 12:25:37.057291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 169/337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:36 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:37.095979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:37.096603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:37.104159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.104652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.105117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.105855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.106312 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.106764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.168086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:37.175600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-87299985-85d5-492f-b48f-6a2f970a113c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.083603 Sep 28 12:25:37.176157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 169/338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:37 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:37.841015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:37.841651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:37.848298 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.848857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.849351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.850038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.850493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.850916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.977424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:37.985032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ae47f24d-9a4d-4192-a0e6-ada12f4238d6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.147852 Sep 28 12:25:37.985625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 170/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:37 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:38.010855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:38.011459 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:38.017396 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.017880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.018307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.018985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.019436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.019856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.079954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:38.080581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:38.086462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.086943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.087382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.088074 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.088531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.088956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.149622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:38.157189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c812e03-121e-4ab3-852e-ac883723d011 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.150202 Sep 28 12:25:38.157786 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:38 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:38.198246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:38.198757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:38.204454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.205044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.205516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.206194 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.206645 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.207060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.225443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:38.233039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4b9aedb3-1759-4c17-b121-f7a283d2e5e8 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.156986 Sep 28 12:25:38.233642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:38 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:38.271472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:38.279102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed4242c8-b577-4673-95d5-1873e1af3c7e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.084686 Sep 28 12:25:38.279660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 171/342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:38 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:39.008398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:39.009001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:39.010848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:39.011534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:39.018270 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.018747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.019177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.019860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.020308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.021323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.151963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:39.159463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9871556b-50cb-4dd1-a40e-9133a803f56a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.155306 Sep 28 12:25:39.160019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 172/343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:39 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:39.181424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:39.182054 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:39.183869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:39.189363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.189844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.190272 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.190951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.191398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.191814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.256441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:39.257070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:39.262862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.263340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.263766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.264446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.264892 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.265339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.323728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:39.331469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e51b0eff-d896-4917-ad83-603e2003ac05 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.154405 Sep 28 12:25:39.332048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 172/344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:39 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:39.347889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:39.348695 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:39.354762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.355246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.355682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.356369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.356826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.357298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.406635 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:39.414907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a5b85155-54d8-41ba-844c-dd6301bead64 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.163013 Sep 28 12:25:39.415554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:39 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:39.421433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:39.429080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5d0cd15f-ac0c-4918-a37b-17829b802c33 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.096102 Sep 28 12:25:39.429748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:39 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:40.182117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:40.182729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:40.189089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.189603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.190034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.190721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.191174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.191593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.315348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:40.324021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6c335b29-e995-4df3-9ea2-d20fe1d7489a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.145715 Sep 28 12:25:40.324586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 174/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:40 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:40.354270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:40.354914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:40.360806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.361328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.361766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.362450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.362905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.363326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.437453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:40.438061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:40.444580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.445095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.447003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.447713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.448170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.448593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.495990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:40.503515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3ef3bac-210e-40b0-856b-4a32d61ea7ce tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.153056 Sep 28 12:25:40.504075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 174/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:40 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:40.510197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:40.510938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:40.516905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.517740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.518156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.518934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.519490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.520015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.577125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:40.580789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:40.585771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ade1a335-a742-4241-9e12-6032cd89635f tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.152086 Sep 28 12:25:40.586342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:40 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:40.589272 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5521beca-1910-42bc-86b3-a4bc0440ed67 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1219 microversion: 2.1 time: 0.084210 Sep 28 12:25:40.589853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 175/350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:40 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:41.347464 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:41.348125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:41.350795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:41.356113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.356542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.357042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.357785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.358519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.358689 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.439918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:41.450415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.450888 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.451327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.465087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] Creating event network-changed:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:25:41.470866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-e270bb3c-c265-46d9-b38c-45b13bbedbc7 req-1f5c66e5-36e4-4c77-aec5-e589965aba22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034918 Sep 28 12:25:41.471465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 176/351] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:41.529714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:41.530407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:41.538670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.539187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.539622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.540320 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.540950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.541401 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.547843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:41.556619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5b9f7ff6-c169-4a02-bd67-ccbe327ee683 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.213229 Sep 28 12:25:41.557528 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 176/352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:41 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:41.614970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:41.615812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:41.622897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.623524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.624043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.624931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.625610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.626099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.704930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:41.714482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2394e9f5-669c-41b6-aa81-0382b2c12a00 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.189944 Sep 28 12:25:41.715943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 177/353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:41 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:41.720467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:41.721077 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:41.728517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.729000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.729468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.730182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.730631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.731103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.814000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:41.819123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:41.825615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-198f035a-4c36-4256-b3e4-31d0e61b9b42 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1267 microversion: 2.1 time: 0.108611 Sep 28 12:25:41.826377 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 178/354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:41 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:41.846644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:41.855091 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e687363-a74d-4464-863b-ac84f3a668b6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1258 microversion: 2.1 time: 0.249919 Sep 28 12:25:41.855716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 177/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:41 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1258 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:42.581020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:42.582203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:42.595258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.595746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.596210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.597325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.597778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.598240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.726059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:42.733626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-14cc34f5-8b91-4475-8bdd-7d83306ce3f7 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.157350 Sep 28 12:25:42.734193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 179/356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:42 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:42.741903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:42.742617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:42.749097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.749607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.750043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.750739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.751198 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.751627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.850776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:42.851391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:42.857283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.857769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.858202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.858891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.859378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.859798 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.879541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:42.887893 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d1de034b-d7f5-4f88-9bf7-79a5a35a2edb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.150158 Sep 28 12:25:42.888871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 178/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:42 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:42.893793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:42.894388 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:42.900239 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.900752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.901203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.901907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.902357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.902804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.925682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:42.934498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a0fef00-045c-4011-9914-410bea43cff5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1267 microversion: 2.1 time: 0.088096 Sep 28 12:25:42.935073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 180/358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:42 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:43.033836 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:43.042461 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1412b318-ce62-4ebf-8e7e-e847adc95201 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1443 microversion: 2.1 time: 0.152313 Sep 28 12:25:43.043027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 179/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:42 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:43.065751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:43.066362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:43.069468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:43.074742 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.075240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.075683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.076584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.077240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.077502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.212226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:43.219825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9bdb604a-8db4-464d-9068-a7b83d7da62e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1443 microversion: 2.1 time: 0.158159 Sep 28 12:25:43.220380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 181/360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:43 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:43.757076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:43.758310 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:43.764551 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.765033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.765670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.766522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.767069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.767498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.899329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:43.906938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a47fc0ca-74b8-435d-8d4a-c4c331408211 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.154614 Sep 28 12:25:43.907509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 180/361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:43 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:43.913200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:43.913954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:43.919842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.920328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.920766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.921605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.922127 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.922476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.957671 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:43.958368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:43.964369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.964851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.965327 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.966009 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.966460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.966881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:44.030108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:44.038549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3a3f9164-78f3-4d43-9c8a-3f87d2553c1e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1267 microversion: 2.1 time: 0.084629 Sep 28 12:25:44.039126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 181/362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:43 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:44.184381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:44.192118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8ba650c3-3afd-41b1-a72f-a2d7c13f0a42 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1321 microversion: 2.1 time: 0.283611 Sep 28 12:25:44.192691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 182/363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:43 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:44.931419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:44.932099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:44.940005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:44.940815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:44.941518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:44.943286 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:44.944005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:44.944635 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.063166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:45.063814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:45.070537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.071680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.072332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.073108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.073662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.074293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.090508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:45.099027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4d23ac0a-5ba1-4fba-82a8-b36dffdee941 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.172482 Sep 28 12:25:45.099717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 182/364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:44 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:45.181085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:45.188869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c9a98071-4e0a-4fa6-86b8-b7cb91392de0 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1273 microversion: 2.1 time: 0.130279 Sep 28 12:25:45.189464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:45 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:45.215058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:45.215661 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:45.221484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.222221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.222652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.223972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.224477 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.224896 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.229720 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:45.360890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:45.369342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a13fd96a-81be-4f89-ac04-12476b385698 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1514 microversion: 2.1 time: 0.157942 Sep 28 12:25:45.369917 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 183/366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:45 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:45.370875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:45.381899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.382500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.382985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.392747 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:45.395834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:45.396204 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] Creating event network-changed:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:25:45.402059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-040d7762-6389-4b72-b000-297abde6c226 req-bf67fdd7-15c9-4ff3-8ff1-e817796e9099 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036157 Sep 28 12:25:45.402224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.402803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.403080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 184/367] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:45.403433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.404227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.405124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.405762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.428799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'flavor' on Instance uuid 6ef4ea58-06f0-4031-a8a0-16d8be1614cb {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:25:45.544333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c8a03b44-2b7f-4fd0-a816-258dce9dc59f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb/action" status: 200 len: 32 microversion: 2.1 time: 0.155416 Sep 28 12:25:45.544926 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 184/368] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:25:45 2022] POST /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 12:25:45.554826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:45.555449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:45.561469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.561950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.562381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.563078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.563503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.564104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.694759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:45.702527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8453d148-886a-46b1-9f12-c40ed76bb592 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.151880 Sep 28 12:25:45.703184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 185/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:45 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:46.123943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:46.124719 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:46.132809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.133329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.133766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.134468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.134926 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.135351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.211866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:46.212471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:46.218564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.219035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.219581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.220149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.220595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.221010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.279597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:46.289779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-913eb2ed-3d6b-428f-b589-7232da69c2b3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.170762 Sep 28 12:25:46.291075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 185/370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:46 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:46.293201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:46.301389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eee4cd8b-1599-4b5c-873b-2774d4295b01 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1273 microversion: 2.1 time: 0.093273 Sep 28 12:25:46.309630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 186/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:46 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:46.728084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:46.728695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:46.736186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.736675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.737120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.737861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.738320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.738769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.888929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:46.899276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-22dfa246-e53e-4259-a582-e861f356d4ad tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.176557 Sep 28 12:25:46.899872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 186/372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:46 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:47.312420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:47.313041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:47.320366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.320850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.321370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.322071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.322527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.322983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.324089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:47.324693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:47.331513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.332021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.332449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.333215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.334844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.335265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.402259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:47.410339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-893a68a4-242c-4c17-a593-5d39da9b4544 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1273 microversion: 2.1 time: 0.090012 Sep 28 12:25:47.411212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 187/373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:47 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:47.455630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:47.463405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e47b9bfc-3e6d-4f4b-9a98-8436972030af tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.154868 Sep 28 12:25:47.464003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 187/374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:47 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:47.922372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:47.922995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:47.929456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.929935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.930366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.931044 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:47.931491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:47.931913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.136152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:48.150351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-56581dbd-3ce7-464c-8066-d672e925b45e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.231681 Sep 28 12:25:48.150946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 188/375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:47 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:48.433025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:48.433913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:48.440228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.441019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.441682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.443369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.444168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.444801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.487488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:48.488969 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:48.495684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.496442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.497062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.498019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.498558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.499169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.570551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:48.582448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f1d51fb1-7bd0-4454-a38b-cdcb711ddb63 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1273 microversion: 2.1 time: 0.153146 Sep 28 12:25:48.585659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 188/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:48 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:48.703280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:48.711800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a3d321d5-f955-41a3-936f-be792c10b27c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.229185 Sep 28 12:25:48.712395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 189/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:48 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:49.175728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:49.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:49.188189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.188672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.189325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.190023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.190474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.190898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.405491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:49.413929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e7310087-e240-4da8-bdaa-3fa8fb98fa5c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.242195 Sep 28 12:25:49.414504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 189/378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:49 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:49.607722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:49.608273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:49.615282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.615755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.616180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.616937 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.617407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.617822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.736013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:49.736764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:49.744642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.745404 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.745835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.746530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.746977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.747399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.756493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:49.764355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ccbdca88-a341-47f6-84d8-472360ab5256 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.160537 Sep 28 12:25:49.764944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 190/379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:49 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:50.026293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:50.041885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-56cc33bd-420b-405f-aed6-cd85ba926785 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.310147 Sep 28 12:25:50.042460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 190/380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:49 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:50.375963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923a7bf4-29f3-439d-b8cd-eb2a006036b5", "tag": "a3ad336b-ad54-4a8e-bde1-f019f5be1a07"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:50.386012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.386486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.386911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.398149 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] Creating event network-changed:a3ad336b-ad54-4a8e-bde1-f019f5be1a07 for instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 on hv-cinder-84456 Sep 28 12:25:50.402879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-dd758dd5-e25d-4ffd-9812-26a7aa32f5ce req-7b17c17c-5491-4df5-9aad-2a86b780f083 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030819 Sep 28 12:25:50.403462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 191/381] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:50.436592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:50.437233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:50.443053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.443535 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.443953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.444637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.445085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.445920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.765501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:50.774259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0a534c1d-00a6-421e-945b-dac32ffa9d52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.341499 Sep 28 12:25:50.775064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 191/382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:50 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:50.788593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:50.789324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:50.802071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.804187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.804759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.806604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.806991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.807691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.846532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "name": "network-vif-plugged", "status": "completed", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:50.865952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.866778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.867318 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.884223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] Creating event network-vif-plugged:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:25:50.928082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-8b19ce04-f27d-4da1-8483-1f5855242b62 req-82d124b8-2083-426d-b394-fec20fad84d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086997 Sep 28 12:25:50.931673 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 192/383] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:50.967108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:50.975562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d98ac9c9-2710-47a8-b32b-130f58cacdfd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.191689 Sep 28 12:25:50.976256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 192/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:50 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:51.065891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:51.073747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:51.080743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.081356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.082060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.083719 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.084241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.084730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.361828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:51.369946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-680cb742-d82f-429e-8c7f-03bcfd20a6b6 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.308194 Sep 28 12:25:51.370494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 193/385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:51 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:51.799723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:51.800357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:51.806927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.807407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.807842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.808526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.808978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.809438 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.937512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:51.945300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2b26db9f-dcf1-4b10-87a0-54b4191c3c0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.149702 Sep 28 12:25:51.945866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 193/386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:51 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:51.998612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:51.999210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:52.004986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.005490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.005917 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.006591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.007032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.007449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.136557 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:52.144214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e453f4a5-7c5e-42e3-92e1-c81db25c8f3e tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.149333 Sep 28 12:25:52.144803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 194/387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:51 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:52.393982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:52.394511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:52.401372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.401862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.402297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.402984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.403435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.403856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.539155 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:52.546868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-25f73150-a0be-43bd-a16a-1846da3691d5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.156762 Sep 28 12:25:52.547438 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 194/388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:52 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:52.969289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:52.969885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:52.976564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.977036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.977493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.978165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.978617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.979030 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.104407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:53.112091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b26258da-9a55-4ef5-94c4-d15878bc9c38 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.146671 Sep 28 12:25:53.112648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 195/389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:52 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:53.167633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:53.168407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:53.175066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.175558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.175995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.177283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.177738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.178194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.306940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:53.314633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-012f118f-8a91-4b80-9747-ba412777f486 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.150904 Sep 28 12:25:53.315196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:53 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:53.571531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:53.572164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:53.578171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.578642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.579067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.579736 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.580179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.580595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.708854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:53.712329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:53.717629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9f018394-2789-46e0-ba08-2a3795157962 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.150605 Sep 28 12:25:53.718190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 196/391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:53 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:54.136011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:54.136651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:54.142524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.143008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.143447 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.144483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.144577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.145693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.275132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:54.282650 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-23d5cb1a-96d9-4679-8bd0-84655f69b63b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.150555 Sep 28 12:25:54.283210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:54 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:54.337814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:54.338416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:54.344364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.344836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.345299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.345971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.346415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.347089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.473968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:54.481365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-62b4fab7-1303-4fcd-a8b7-2edec5ba57dd tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.147334 Sep 28 12:25:54.481921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:54 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:54.742405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:54.743021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:54.748946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.749545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.749991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.750689 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.751145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.751569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.892372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:54.900451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8ba5b111-4786-479a-b560-188a9f2675a1 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.162318 Sep 28 12:25:54.901027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:54 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:55.307412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:55.308040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:55.313839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.314309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.314736 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.315410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.315854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.316265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.447757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:55.455351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6452b74f-13a7-41e3-ad81-461f827dcb47 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.151771 Sep 28 12:25:55.455903 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:55 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:55.503936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:55.505510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:55.512060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.512540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.512973 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.513703 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.514157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.514604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.538324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:55.657665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:55.665575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9c45e5b8-4389-4bde-b211-81ab568884b5 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.165571 Sep 28 12:25:55.666135 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 198/396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:55 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:55.924076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:55.925090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:55.933519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.934601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.935516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.936992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.937637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.938130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.079436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:56.089910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1dabcc07-f014-4888-8919-70c147981e77 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1358 microversion: 2.1 time: 0.170802 Sep 28 12:25:56.090475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 199/397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:55 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:56.480216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:56.480826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:56.486936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.487419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.487857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.488652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.489002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.489458 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.618712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:56.626332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1a6f53d5-faf1-4095-b4be-b1f527ba64ac tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.149971 Sep 28 12:25:56.626894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 199/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:56 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:56.687691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:56.688302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:56.695065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.695550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.695990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.696672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.697150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.697573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.826201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:56.834783 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e07203fe-1012-4f90-ab74-20e111d680cc tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.150888 Sep 28 12:25:56.835361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 200/399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:56 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:57.003682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923a7bf4-29f3-439d-b8cd-eb2a006036b5", "name": "network-vif-plugged", "status": "completed", "tag": "a3ad336b-ad54-4a8e-bde1-f019f5be1a07"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:57.017378 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.017855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.018281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.031175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] Creating event network-vif-plugged:a3ad336b-ad54-4a8e-bde1-f019f5be1a07 for instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 on hv-cinder-84456 Sep 28 12:25:57.038240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-fa7f1c5d-fb5d-47a0-a43f-a571c0c51cc0 req-d3b66623-7f0b-4b8d-b012-c552378c4248 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Sep 28 12:25:57.039047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 200/400] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:57.113966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.114679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.120973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.121493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.121928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.122623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.123088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.123497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.281767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:57.289474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2976a08e-708f-4f74-a172-ddd9bdc06aa5 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1549 microversion: 2.1 time: 0.179876 Sep 28 12:25:57.290051 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 201/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:57.313663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.315197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.322689 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.323377 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.323972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.324669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.325127 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.325578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.482030 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:57.490309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f8646f17-1666-4ea5-b471-16c1cfe62139 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1549 microversion: 2.1 time: 0.181149 Sep 28 12:25:57.490876 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:57.511772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.524748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:57.524748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Searching by: {'deleted': False, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6'} {{(pid=120392) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 12:25:57.527282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.527825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.528190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.528913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.529394 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.529816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.617469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.multi_cell_list [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120392) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 12:25:57.650222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.650823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.657166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.657643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.658076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.658757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.659240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.659657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.713353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fb151be0-fc33-41ec-ba53-969ca1f4271b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205313 Sep 28 12:25:57.713958 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:57.726358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.726957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.733109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.733629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.734064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.734755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.735202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.735629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.792352 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:57.799983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e0ce9e11-c77e-46d8-adb6-125aebde0476 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.153574 Sep 28 12:25:57.800546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:57.858228 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.858827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.864026 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:57.864734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.865247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.865690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.866384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.866831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.867251 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.871715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a13417a-6125-4d50-8cea-97782031c754 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1549 microversion: 2.1 time: 0.150164 Sep 28 12:25:57.872365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 203/405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:57.998680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:58.006831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fc94be9a-e53b-4d09-8556-11a215dd9c2f tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.152384 Sep 28 12:25:58.007407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:58.823666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:58.824336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:58.830239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:58.830721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:58.831159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:58.831874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:58.832454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:58.832973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:58.962506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:58.970094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-185f4bf9-bed5-41cf-b280-7150a02615fe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.150306 Sep 28 12:25:58.970654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:58 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:59.030082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:59.030682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:59.037547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.038025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.038455 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.039133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.039584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.040002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.165194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:59.172944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-92c97268-1695-4fdf-afce-b51bb183565b tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1315 microversion: 2.1 time: 0.146676 Sep 28 12:25:59.173567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 204/408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:59 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:59.420010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d13344bc-7599-4c98-8f03-9caba4e66d44"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:59.422423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:59.428546 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.429019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.429480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.430154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.430598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.431012 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.993621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:59.994256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:00.000287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.000774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.001234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.001922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.002378 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.002822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.356131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7dfb98ed-78b6-4ea4-89b2-8564c654138d tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939365 Sep 28 12:26:00.356846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 205/409] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:25:59 2022] POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:00.367781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:00.368527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:00.377878 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.378376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.379750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.380827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.381392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.381662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:00.382225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.394428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-82b41bda-cb01-4598-8fe4-9293fe38652a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.403980 Sep 28 12:26:00.395639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 205/410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:59 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:00.530162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:00.538991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c5ad9d98-5137-43b9-9d00-65639b456ead tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1465 microversion: 2.1 time: 0.176254 Sep 28 12:26:00.539549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 206/411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:00 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:00.588874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:00.589406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:00.595645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.596134 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.596573 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.597670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.598131 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.598556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.623910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:26:00.713918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b9ff5ee2-2c6d-423b-9fa8-b90a2b2c9d6c tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "DELETE /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 204 len: 0 microversion: 2.1 time: 0.129013 Sep 28 12:26:00.714531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 206/412] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:26:00 2022] DELETE /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:26:00.722835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:00.723431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:00.729419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.729887 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.730312 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.730984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.731433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.731849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.861363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:00.869428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-808cab86-1b1b-45a0-b8dd-302c26d01052 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1471 microversion: 2.1 time: 0.150656 Sep 28 12:26:00.869985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 207/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:00 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:01.419016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:01.419695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:01.425611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.426611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.427065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.427748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.428205 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.428624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.557035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:01.564870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-631c59d7-ccea-4aee-839c-d6a62534fa9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.150086 Sep 28 12:26:01.565494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 207/414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:01 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:01.648750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:01.649313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:01.655729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.656200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.656623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.657330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.657773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.658188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.680673 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7e39be78-54b4-495d-ade3-7c9abdc89b39 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/ips" status: 200 len: 149 microversion: 2.1 time: 0.036233 Sep 28 12:26:01.681236 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 208/415] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:26:01 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:01.894488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:01.895710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:01.902249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.902838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.903269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.904054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.904542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.904961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:02.055786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:02.063397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-24e303be-194f-40e4-9856-c0fb06c983ec tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1471 microversion: 2.1 time: 0.173185 Sep 28 12:26:02.063964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:01 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:02.588551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:02.589177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:02.595063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:02.595545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:02.595984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:02.596927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:02.597415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:02.598764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:02.725829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:02.733297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b13986c4-b60e-43c3-97da-8cc0cbb08f18 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.148476 Sep 28 12:26:02.733855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 209/417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:02 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:03.054818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd95400b-9bae-4237-bd5e-a83f9f444b9d"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:03.057225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:03.063516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.063994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.064425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.065258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.065717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.066136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.086417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:03.087175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:03.093408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.094005 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.094558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.095347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.095893 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.096407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.232258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:03.240512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5dbb21b8-08c6-46bd-99c2-7388515480e6 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1471 microversion: 2.1 time: 0.158438 Sep 28 12:26:03.241080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 210/418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:03 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:03.379356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-51dcba51-b52e-43ed-b98f-665720b99c1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328259 Sep 28 12:26:03.388077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 209/419] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:26:03 2022] POST /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:03.407045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923a7bf4-29f3-439d-b8cd-eb2a006036b5", "name": "network-vif-deleted", "tag": "a3ad336b-ad54-4a8e-bde1-f019f5be1a07"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:03.425279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.426669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.427320 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.439630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] Creating event network-vif-deleted:a3ad336b-ad54-4a8e-bde1-f019f5be1a07 for instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 on hv-cinder-84456 Sep 28 12:26:03.445048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b7a7e154-42d1-4d2b-b5e2-60212b21d860 req-7375b589-e7b9-4b23-a577-f8afe0347ae2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042972 Sep 28 12:26:03.445968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 211/420] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:03.756615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:03.757364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:03.763921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.764399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.764829 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.765546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.765993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.766413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.907483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:03.915435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d877c0e9-abea-4dbc-952f-348341b35007 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.163469 Sep 28 12:26:03.915944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:03 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:04.267015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:04.267820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:04.274427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.274911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.275340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.276027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.276480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.276899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.308857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.309372 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.309805 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.310257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lazy-loading 'fault' on Instance uuid 923a7bf4-29f3-439d-b8cd-eb2a006036b5 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:26:04.315840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:04.362724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12d46f42d73486fbbc3a1c2df0f3ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14944124ab8a4487b879592a02981d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:04.371260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ab7fd9e2-d96e-4e36-80f5-15b5c9bc1529 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 200 len: 1305 microversion: 2.1 time: 0.108823 Sep 28 12:26:04.371839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 212/422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:04 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:04.938898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:04.939498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:04.946631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.947152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.947583 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.948271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.948722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.949160 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:05.078648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:05.086939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5351ce2a-7fc9-4dde-90b8-be9218bca1d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.151812 Sep 28 12:26:05.087500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 211/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:04 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:05.394959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:05.395519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] [instance: 923a7bf4-29f3-439d-b8cd-eb2a006036b5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:05.401818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:05.402297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:05.402735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:05.403409 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:05.403855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:05.404277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:05.417323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] HTTP exception thrown: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Request method failure captured: Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 HTTP/1.1 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND015iJINatP0ZNoTJeNWR9uzDiMr69qi0nOe-2sgfqDreyKdfHAAa4H4dKRwiTfP27rn97Evd9K1JiHfXwkO80u8uhMMepQ21APlP69cUlLjQoGnGAtbTq1STC6qc6XlG9-4T3scsSueYH-PqtKml4YSrON8p2FbqJcsw-ufAT8Rhg Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 14944124ab8a4487b879592a02981d12 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesNegativeTest-1143725331 Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:26:05.418918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14944124ab8a4487b879592a02981d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/14944124ab8a4487b879592a02981d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_14944124ab8a4487b879592a02981d12", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14944124ab8a4487b879592a02981d12"}]}] Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesNegativeTest-1143725331 Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 14944124ab8a4487b879592a02981d12 Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesNegativeTest-1143725331 Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesNegativeTest-1143725331-project Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: d12d46f42d73486fbbc3a1c2df0f3ab9 Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesNegativeTest-1143725331-project Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. Sep 28 12:26:05.420475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '923a7bf4-29f3-439d-b8cd-eb2a006036b5'} Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:26:05.421644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. Sep 28 12:26:05.423069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:05.424327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] Returning 404 to user: Instance 923a7bf4-29f3-439d-b8cd-eb2a006036b5 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:26:05.424327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-097ce197-a1f1-430d-81ef-b85000380b13 tempest-VolumesNegativeTest-1143725331 tempest-VolumesNegativeTest-1143725331-project] 10.222.0.60 "GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5" status: 404 len: 111 microversion: 2.1 time: 0.029705 Sep 28 12:26:05.424327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 213/424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:05 2022] GET /compute/v2.1/servers/923a7bf4-29f3-439d-b8cd-eb2a006036b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:26:06.110592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:06.111204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:06.118075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:06.118565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:06.119005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:06.119706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:06.120163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:06.120888 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:06.253869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:06.257737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:06.263216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8c7fe569-06df-4327-b8cd-985fd9611227 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.156435 Sep 28 12:26:06.263760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 212/425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:06 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:07.286739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:07.287351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:07.294480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:07.294480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:07.294799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:07.295482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:07.296101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:07.296526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:07.430423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:07.437980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5b605160-d706-47e7-8cd5-2a20951a5fdd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.155207 Sep 28 12:26:07.438559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 214/426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:07 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:08.462552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:08.463157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:08.470677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:08.471162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:08.471864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:08.472705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:08.473213 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:08.473642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:08.615240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:08.623066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f0bbf98d-8064-4df7-9ddb-23b0c5e1d63c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.164749 Sep 28 12:26:08.623619 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 213/427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:08 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:09.040874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:09.041524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:09.043313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:09.049228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.049711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.050144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.050828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.051278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.051707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.180923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:09.189417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7db5f78c-313f-4cd2-8a57-73d550f76937 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1595 microversion: 2.1 time: 0.152319 Sep 28 12:26:09.189980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 215/428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:09 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:09.650001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:09.650626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:09.657207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.657734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.658370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.659080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.659614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.660548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.822288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:09.832101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e7220b40-3bf3-40fa-b770-d802d7b382e2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.187057 Sep 28 12:26:09.833296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 214/429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:09 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:10.857674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:10.858291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:10.868437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:10.868938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:10.869400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:10.870144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:10.870552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:10.873172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:11.132021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:11.139860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2eaa7321-b853-477d-9741-c4a3cab445b6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.285960 Sep 28 12:26:11.140550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 216/430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:10 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:11.308298 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:11.319278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:11.319757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:11.320190 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:11.333924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] Creating event network-changed:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:26:11.339012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-1f2f5264-69f1-4c5a-a699-765e432f3ba9 req-93f25c6d-a35d-474b-8fe0-6feac1a987e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034280 Sep 28 12:26:11.339684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 215/431] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:12.164767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:12.165510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:12.176049 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.177276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.180028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.180978 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.182220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.183176 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.424536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:12.434650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4015b599-3ab3-46cb-a77f-a18b289c0941 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.274642 Sep 28 12:26:12.435754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 217/432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:12 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:12.488479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-157806550"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:12.489740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:12.492055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:12.497582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.498058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.498486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.499161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.499611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.500024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.632722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.network.security_group_api [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Adding security group a0f26316-ff48-45b5-8a12-373ee9ed20e6 to port f219904c-e6fd-43ca-be72-0b2ebac9da8f Sep 28 12:26:12.935446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0943c911-6bdc-40c7-a38f-67d26bc2ea5c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action" status: 202 len: 0 microversion: 2.1 time: 0.451684 Sep 28 12:26:12.936077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 216/433] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:26:12 2022] POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:26:12.944517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:12.945125 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:12.951060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.951538 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.951971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.952653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.953751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.954176 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.965693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:12.975991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.976738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.977282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.989344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] Creating event network-changed:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:26:12.994402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-ea198ef6-30ee-4fa8-a9b0-78d3e29f761d req-e005d50d-064b-4d68-81b2-660dd9d36fb2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Sep 28 12:26:12.995071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 217/434] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:13.100011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:13.108326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-abe0bc67-7033-4fdc-95ed-fb0782c764f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1759 microversion: 2.1 time: 0.168172 Sep 28 12:26:13.108877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 218/435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:12 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:13.459745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:13.460477 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:13.466756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:13.467245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:13.467682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:13.468372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:13.468831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:13.469287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:13.596363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:13.605265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-400ad2f4-3cc1-4c71-8485-b7ac9895bc9a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.149855 Sep 28 12:26:13.605832 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 218/436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:13 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:14.629229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:14.629842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:14.632156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=78 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:14.637493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:14.637976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:14.638413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:14.639089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:14.639540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:14.639962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:14.770577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:14.778624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-de3c3d47-a23a-4770-83da-e987eb68ac52 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.153891 Sep 28 12:26:14.779192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 219/437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:14 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:15.802801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:15.803408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:15.809871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:15.810343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:15.810767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:15.811450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:15.811895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:15.812309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:15.941358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:15.948942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-cba9a2d0-fcfa-4c4d-86e2-bcbd1eb3d020 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.150280 Sep 28 12:26:15.949582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 219/438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:15 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:16.973108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:16.973764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:16.980007 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:16.980483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:16.980914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:16.981686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:16.982135 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:16.982554 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:17.109017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:17.118009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c44ec46-e37e-46b1-85e8-564a41b48d36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.149675 Sep 28 12:26:17.118581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 220/439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:16 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:17.465869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:17.466478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:17.473843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:17.474354 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:17.474786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:17.475537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:17.475966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:17.476378 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:17.505412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-62a6f3cf-7262-4596-ad6b-05a035754906 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/ips" status: 200 len: 153 microversion: 2.20 time: 0.043195 Sep 28 12:26:17.506278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 220/440] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 28 12:26:17 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:26:18.141258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:18.141868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:18.148152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:18.148627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:18.149074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:18.149771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:18.150222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:18.150649 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:18.275507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:18.283147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-27b0177d-cdf9-4f62-8552-381678376bf2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.145732 Sep 28 12:26:18.283714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 221/441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:18 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:19.307224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:19.307832 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:19.314202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:19.314686 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:19.315121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:19.316348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:19.316804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:19.317259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:19.448312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:19.455947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7a74b0a5-2bb7-4bb7-885e-a493977f8f96 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.152994 Sep 28 12:26:19.457323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 221/442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:19 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:20.479576 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:20.480185 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:20.486304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:20.486790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:20.487223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:20.487977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:20.488430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:20.488852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:20.621784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:20.630037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5d2c9ea2-e093-4722-ae08-a8fe6a270560 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.154260 Sep 28 12:26:20.630598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 222/443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:20 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:21.654466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:21.655069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:21.662143 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:21.662625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:21.663052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:21.663742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:21.664196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:21.664615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:21.795454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:21.803184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ef757350-ca63-494a-8c22-254af4fe3a3b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.152494 Sep 28 12:26:21.803743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 222/444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:21 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:22.709967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: .version_select at 0x7fa706e16f70>, body: {"keypair": {"name": "tempest-keypair-1916556233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyE0WVgeUMVp5W3TgRlYaN4mhsa8FqNvs2eAEuwT78Mn/TAAKpKZayzc9ZfDhD8yBpsdGvUEl8ONV5TyZyukNEGZ9ZDx6aFoKhc+uepKYWCa8FilEbIruZ8JZqkX4FCYw=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:22.726088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:26:22.730090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:26:22.742735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR oslo.messaging._drivers.impl_rabbit [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [b71f29a2-9443-4fc5-be6b-22fe91127321] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:26:22.826733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:22.827332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:22.833735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:22.834213 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:22.834642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:22.835317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:22.835770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:22.836185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:22.967106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:22.975662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e3905503-7988-473f-a559-c1e5ad0eaf5f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.152755 Sep 28 12:26:22.976384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 223/445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:22 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:23.751501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [b71f29a2-9443-4fc5-be6b-22fe91127321] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33958. Sep 28 12:26:23.768523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-189d99b7-a4b7-43dc-add0-cf8b04e00b80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.062411 Sep 28 12:26:23.769341 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 223/446] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:26:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:24.000898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:24.002147 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:24.010022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.010515 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.010954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.011652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.012111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.012542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.154044 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:24.164096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7aa20a9d-783c-46b5-8b9a-ea097c1c3715 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.167031 Sep 28 12:26:24.164782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 224/447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:23 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:24.620291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:24.620821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:24.627446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.627922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.628351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.629708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.630159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.630581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.653508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lazy-loading 'flavor' on Instance uuid 3ae6ec0b-f117-438a-8147-6b661b54accd {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:26:24.877536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a53ad7a-7ec7-4932-98dc-216def8b8e1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/action" status: 202 len: 0 microversion: 2.20 time: 0.260943 Sep 28 12:26:24.878144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 224/448] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 12:26:24 2022] POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:26:24.887131 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:24.887736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:24.894037 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.894550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.894981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.895756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.896440 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.897041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.028643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:25.037538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:25.038971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:25.040115 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9617c5e7-c711-46d1-83be-bd177584006a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.157064 Sep 28 12:26:25.040667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 225/449] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:24 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:25.090096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75427883", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75ba08fd-c198-48e0-8c9c-8b6efb7d5c44"}], "security_groups": [{"name": "tempest-securitygroup--1027864146"}], "key_name": "tempest-keypair-1916556233", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:25.188152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:25.188764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:25.193746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] validate_networks() for [('75ba08fd-c198-48e0-8c9c-8b6efb7d5c44', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:26:25.194791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.195284 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.195714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.196408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.196860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.197318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.338047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:25.345825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-67bcf3bf-c0ff-44d4-81af-515093a4e455 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.161559 Sep 28 12:26:25.346750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 226/450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:25 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:25.563280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:26:25.563703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:26:25.564174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:26:25.564578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:26:25.564987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:26:25.573848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.574347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.574781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.575499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.575949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.576370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.593456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:26:25.598232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:26:25.608964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:26:25.611350 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:26:25.658292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7fc9a1e4-a04d-46eb-a6ba-4c4b0d4a8524 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572803 Sep 28 12:26:25.658931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 225/451] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:26:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:26:25.670626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-022494f9-6f85-4129-9d47-3236658835fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:25.671305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-022494f9-6f85-4129-9d47-3236658835fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:25.723254 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-022494f9-6f85-4129-9d47-3236658835fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:25.731811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-022494f9-6f85-4129-9d47-3236658835fe tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1240 microversion: 2.1 time: 0.065006 Sep 28 12:26:25.732410 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 227/452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:25 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:26.065555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:26.066191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:26.073074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.073586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.074022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.074716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.075170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.075598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.205471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:26.216071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:26.218311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:26.219672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-84cf4d16-2fc4-4b28-8087-1d441bacf2a8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.158571 Sep 28 12:26:26.220229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 226/453] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:26 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:26.370329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:26.370855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:26.378232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.378723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.379803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.380531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.380986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.381443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.505814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:26.513491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-81337b44-b668-413e-af1a-3eda4776d4af tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.147055 Sep 28 12:26:26.514049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 228/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:26 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:26.754613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:26.755208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:26.761123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.761633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.762048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.762721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.763168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.763583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.825118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:26.832872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cbea1e5e-1f74-4179-b8f6-56508b171a91 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1244 microversion: 2.1 time: 0.081958 Sep 28 12:26:26.833475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 227/455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:26 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:27.244748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:27.245411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:27.251418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.251904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.252338 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.253028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.253596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.254197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.382272 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:27.390389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:27.391838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:27.393037 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3c472e3d-d590-4d0a-a38c-b4b6731fa02f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.152142 Sep 28 12:26:27.393629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 229/456] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:27 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:27.535844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:27.538172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:27.542743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.543222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.543650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.544327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.544773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.546113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.675477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:27.683043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e9dc81a6-adac-4510-a7ab-e24518ed01f8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.151209 Sep 28 12:26:27.683619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 228/457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:27 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:27.855518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:27.856152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:27.862212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.862729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.863814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.871681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.872178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.872616 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.932852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:27.940374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-48036895-432b-4ddb-9e86-3eafb587383f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1244 microversion: 2.1 time: 0.088699 Sep 28 12:26:27.940938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 230/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:27 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:28.419326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:28.419850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:28.426382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.426864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.427302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.427986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.428443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.428862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.446137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:28.556486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:28.564408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:28.565977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:28.567175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-57239586-fa1c-4183-a8c0-da4e4bec2fbf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.151879 Sep 28 12:26:28.567717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 229/459] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:28 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:28.707414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:28.708200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:28.714741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.715212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.715639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.716321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.716766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.717201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.845120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:28.853741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b80aa442-43b9-4162-bb9d-49649ecbbf01 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.150945 Sep 28 12:26:28.854300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 231/460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:28 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:28.964043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:28.964595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:28.970506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.971095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.971850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.972718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.973297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.973728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.032639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:29.040286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a1f22325-c66e-40ca-b2f3-95acf2008f3a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1236 microversion: 2.1 time: 0.080188 Sep 28 12:26:29.041034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 230/461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:28 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:29.593016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:29.593730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:29.600730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.601248 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.601677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.602509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.602999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.603424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.622760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:29.741465 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:29.749535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:29.750971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:29.752139 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-46a974d1-7748-493f-8191-7482e0b2cd28 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.163021 Sep 28 12:26:29.752686 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 232/462] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:29 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:29.877232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:29.877756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:29.883675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.884147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.884574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.885286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.885732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.886148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.016603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:30.026662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eb10a85d-619d-4f65-993e-74f77ac547da tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.153524 Sep 28 12:26:30.027220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 231/463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:29 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:30.062768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:30.063494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:30.069980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.070545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.071050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.071878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.072394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.072892 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.136201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:30.143762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-efa28fdb-84e6-4b2d-bcdd-7f08761a667f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1292 microversion: 2.1 time: 0.084773 Sep 28 12:26:30.149297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 233/464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:30 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:30.777561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:30.778165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:30.784317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.784810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.785281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.786060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.786557 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.786985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.919355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:30.928249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:30.929746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:30.930879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f69c1073-e181-4db7-85a5-581ad018c7f1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.157240 Sep 28 12:26:30.931422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 232/465] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:30 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:31.052624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:31.053277 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:31.059909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.060582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.061096 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.062027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.062544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.062992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.167609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:31.167786 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:31.174051 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.174540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.174973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.175727 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.176223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.176648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.197783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:31.205371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-77c023ed-909b-4122-bf44-21518e1b89d7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.158011 Sep 28 12:26:31.205944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 234/466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:31 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:31.239814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:31.247345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-310f8c57-514a-4e7d-9936-bcdc5d682a84 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1300 microversion: 2.1 time: 0.084060 Sep 28 12:26:31.247912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 233/467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:31 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:31.955593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:31.956198 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:31.962210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.962685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.963114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.963823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.964285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.964685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.153760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:32.168584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:32.173624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:32.175556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-44fbb3e5-31fa-4952-882f-d8a217baf94f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.223506 Sep 28 12:26:32.177000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 235/468] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:31 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:32.230480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:32.231121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:32.237599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.238837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.239314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.239984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.240442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.240867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.272111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:32.272728 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:32.282605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.285972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.286443 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.287163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.291267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.291849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.354842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:32.363087 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-02e0e90b-59be-4bc0-925f-fcfaaf63e9b5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1298 microversion: 2.1 time: 0.095983 Sep 28 12:26:32.363790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 236/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:32 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:32.415000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:32.422677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b372e479-ec63-4f0b-81ae-81f0e0ef55db tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.196283 Sep 28 12:26:32.423237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 234/470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:32 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:33.203463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:33.204079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:33.210639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.211118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.211546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.212231 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.212681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.213097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.385806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:33.386452 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:33.392899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.393420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.393890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.394862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.395390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.396056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.423718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:33.434220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:33.435850 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:33.437052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c5b0bcac-99ab-4ae0-88e8-7f2d1b4d23ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.237508 Sep 28 12:26:33.437900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 237/471] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:33 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:33.458275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:33.458966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:33.469021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.469625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.470337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.471107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.471955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.473721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.476057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:33.486574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-704c3bd3-dcf5-44fd-b54c-36b5ac292f15 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1298 microversion: 2.1 time: 0.104275 Sep 28 12:26:33.487151 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 235/472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:33 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:33.657709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:33.666444 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8bb1da7a-0b81-40eb-ad7f-20d549a64c7c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1520 microversion: 2.1 time: 0.217654 Sep 28 12:26:33.667029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 238/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:33 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:34.464392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:34.464938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:34.471776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.472338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.472858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.473671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.474191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.474636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.512659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:34.514754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:34.522373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.522914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.523355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.524060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.524516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.524944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.723684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:34.732495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b9d4f2d7-f6b5-44e6-8bc8-40755fdb0e10 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.225471 Sep 28 12:26:34.733306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 239/474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:34 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:34.752916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:34.754577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:34.761179 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.761932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.762553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.763440 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.764059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.764642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.856357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:34.866762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:34.868524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:34.869729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e3248bcd-bc5c-4955-9439-67ae35fa51b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.409550 Sep 28 12:26:34.870452 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 236/475] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:34 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:34.896062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bf4bcb-fcb0-4571-ab62-a01a701e27aa", "tag": "1f3e04c1-ffca-4137-b169-3bf2fa937308"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:34.907136 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.907665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.908095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.920287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] Creating event network-changed:1f3e04c1-ffca-4137-b169-3bf2fa937308 for instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa on hv-cinder-84456 Sep 28 12:26:34.925913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-3f035a06-07d4-4bc5-ada5-b87cf504d7ea req-3f40752e-c7c4-4686-aaa3-6f9663949c73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039368 Sep 28 12:26:34.926831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 237/476] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:34.996465 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:35.004639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ed0ef94e-a2cf-47df-8c4c-8f2fd529436f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1500 microversion: 2.1 time: 0.262495 Sep 28 12:26:35.005236 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 240/477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:34 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:35.028009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:35.028786 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:35.034915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.035503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.036011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.036693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.037154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.037584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.166598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:35.175470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3d34196c-5d54-4b3e-8885-2e39598529ba tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1515 microversion: 2.1 time: 0.151633 Sep 28 12:26:35.176279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 238/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:35 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:35.760051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:35.760887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:35.763203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:35.768492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.769351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.769782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.770485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.770970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.771401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.895523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:35.896360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:35.898928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:35.900131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:35.906908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.907509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.907649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:35.908154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.908944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.909529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.910595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.918441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-45c15d6d-0742-4438-89a0-35174f48ad5a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.162015 Sep 28 12:26:35.919163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 241/479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:35 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:36.088204 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:36.098302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:36.100057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:36.101297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45b7c0fd-5f1f-49be-9ff1-7bbf97add189 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.210209 Sep 28 12:26:36.101874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 239/480] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:35 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:26:36.608717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:36.611077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:36.617274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.617753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.618180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.618858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.619305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.619722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.643192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'flavor' on Instance uuid 2b649038-e0a8-45a6-a118-534dcc182549 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:26:36.714463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8aa08ab0-f3fd-46ae-9b25-79d2805a6017 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/action" status: 200 len: 32 microversion: 2.1 time: 0.109707 Sep 28 12:26:36.715056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 242/481] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:26:36 2022] POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:26:36.724862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:36.725564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:36.731463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.731946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.732402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.733098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.733592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.734017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.864431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:36.871907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b7439b6e-cfc2-44fd-b7d6-b6ec81e6dba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.151134 Sep 28 12:26:36.872464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 240/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:36 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:36.944956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:36.945731 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:36.951940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.952426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.952863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.953586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.954044 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.954468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.085102 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:37.092573 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2a81a76c-df2e-4e09-9a94-a096dcc13fd2 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.153184 Sep 28 12:26:37.093145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 243/483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:36 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:37.126186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:37.126789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:37.133040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.133549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.133981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.134660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.135110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.135529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.267842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:37.276009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:37.277517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:37.278659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f0a4af2e-22d7-4c1c-9c52-94807dc06533 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.156320 Sep 28 12:26:37.279206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 241/484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:37 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:37.896977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:37.897613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:37.903598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.904082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.904513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.905229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.905687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.906109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.028836 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:38.036464 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-be17e950-a1d7-4625-8995-3ce321840b1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.144044 Sep 28 12:26:38.037036 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 244/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:37 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:38.115772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:38.116364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:38.122219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.122695 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.123121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.123789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.124237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.124650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.256108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:38.263662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-54cbe35b-11c8-4a02-a27b-1a56b102e707 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.151878 Sep 28 12:26:38.264219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 242/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:38 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:38.307684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:38.308442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:38.314332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.314845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.315278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.316698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.317295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.317724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.544333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:38.553963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:38.555603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:38.556906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c029df2a-2141-4305-891b-472a563f42c4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.256537 Sep 28 12:26:38.557787 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 245/487] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:38 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:26:39.059515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:39.060121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:39.065975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.066550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.066985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.067679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.068131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.068550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.199877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:39.208275 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b02348bb-9ec4-46f8-9139-5fcb51c17d2b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.152501 Sep 28 12:26:39.208828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 243/488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:39 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:39.287027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:39.287667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:39.293788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.294268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.294702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.295391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.295848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.296268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.426340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:39.433783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f6dfee55-f718-4c48-b10b-52c677c9b3a0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.151116 Sep 28 12:26:39.434344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 246/489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:39 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:39.583433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:39.583978 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:39.589785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.590266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.590701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.591381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.591832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.592251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.723200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:39.731321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:39.732778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:39.734084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9a94728f-8864-4d1c-b2c7-1fa7f33bf6e9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.154856 Sep 28 12:26:39.734642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 244/490] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:39 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:40.232135 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:40.232739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:40.238834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.239314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.239748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.240432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.240884 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.241336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.245354 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:40.368474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:40.376132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ae29f3a7-a17a-4d99-bd45-8df90b249605 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.147831 Sep 28 12:26:40.376690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 247/491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:40 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:40.455996 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:40.457231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:40.463557 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.464037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.464467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.465164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.465610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.466028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.595228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:40.603124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8f65b752-7ced-43d9-bd8f-8ef9d997135f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.150859 Sep 28 12:26:40.603707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 245/492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:40 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:40.760415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:40.760935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:40.766762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.767245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.767667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.768343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.768913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.769434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.900453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:40.908471 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:40.910691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:40.911840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0d97d182-1af5-4502-90d8-c9b6373e8fa3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.155461 Sep 28 12:26:40.912398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 248/493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:40 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:41.400799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:41.401428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:41.407258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.407734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.408162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.408838 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.409316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.410368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.539969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:41.543477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:41.548566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fbfef567-477b-4b2f-9a08-7f531674e8c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.151629 Sep 28 12:26:41.549240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 246/494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:41 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:41.626933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:41.627533 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:41.634537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.635356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.636101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.636903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.637384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.637814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.679973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf4bcb-fcb0-4571-ab62-a01a701e27aa", "name": "network-vif-plugged", "status": "completed", "tag": "1f3e04c1-ffca-4137-b169-3bf2fa937308"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:41.694636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.695377 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.696012 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.709874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] Creating event network-vif-plugged:1f3e04c1-ffca-4137-b169-3bf2fa937308 for instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa on hv-cinder-84456 Sep 28 12:26:41.715474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-6e0cf183-0334-4005-8d53-056b578fbf63 req-d5f2b81b-a796-4bc5-86a4-a1b01db45c43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040068 Sep 28 12:26:41.716818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 247/495] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:41.770993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:41.778470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5f0903f2-cf7c-4b07-94f3-9160ab84cce6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.155382 Sep 28 12:26:41.779031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 249/496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:41 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:41.938090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:41.938809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:41.945784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.946259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.946683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.947373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:41.947820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:41.948234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.080955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:42.089344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:42.090792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:42.091941 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bbc25b72-a778-4571-a1d4-8c26e4521bbe tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.158091 Sep 28 12:26:42.092493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 248/497] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:41 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:42.571859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:42.572456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:42.574364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=70 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:42.579528 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.580003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.580432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.581111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.581585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.581994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.726490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:42.734987 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b2de60b8-939d-4762-8ea9-56b5499df52b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.166967 Sep 28 12:26:42.735550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 250/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:42 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:42.801113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:42.801767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:42.808054 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.808531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.808963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.809683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.810131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.810552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.944300 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:42.951823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a2a68de8-77f4-48f8-8459-1dc41ed13e48 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.154654 Sep 28 12:26:42.952388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 249/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:42 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:43.117919 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:43.118559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:43.124501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.124956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.125429 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.126125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.126583 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.127009 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.252702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:43.261457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:43.262957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:43.264180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-adf1b15e-d582-44d1-bc26-3e0e00fecb90 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.150385 Sep 28 12:26:43.264834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 251/500] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:43 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:26:43.760444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:43.760979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:43.766762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.767229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.767655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.768335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.768834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.769274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.897103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:43.905464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cce984d-fa42-4516-b1fa-ea022b3e9571 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.148921 Sep 28 12:26:43.906019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 250/501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:43 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:43.982921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:43.983516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:43.990785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.991261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.991686 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.992366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.992812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.993266 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.123899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:44.132089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-feda67a8-cb29-4478-9b87-d65f3ea0fa1b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1366 microversion: 2.1 time: 0.152976 Sep 28 12:26:44.132692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 252/502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:43 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:44.291738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:44.292300 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:44.298137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.298609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.299034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.299706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.300411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.300831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.427862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:44.436133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:44.437594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:44.439260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-90051956-c892-4a3e-a599-816b5238d7d8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.150990 Sep 28 12:26:44.439846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 251/503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:44 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:44.929645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:44.930250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:44.936111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.936589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.937019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.937726 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.938183 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.938627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.064536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:45.073081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-127f959b-cd55-4be6-b91c-1e7f7856ad06 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.147260 Sep 28 12:26:45.073722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 253/504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:44 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:45.155189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:45.155800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:45.158241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:45.164189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.164665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.165090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.165801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.166246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.166660 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.298617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:45.306735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-70441dc5-9078-4d4e-800b-7ef9b80a6be5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1556 microversion: 2.1 time: 0.155437 Sep 28 12:26:45.307294 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 252/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:45 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:45.329334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:45.329819 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:45.335934 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.336412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.336840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.337583 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.338031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.338448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.418448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-986784b4-4f8e-4ba7-8d55-0e2064b8689d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092871 Sep 28 12:26:45.419043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 254/506] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:26:45 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:45.463826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:45.464431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:45.470277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.470760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.471444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.472624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.473076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.473519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.606437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:45.616106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:45.617820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:45.619073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b9f7a6ef-9fc9-4279-8d8e-7c9698434b88 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.159237 Sep 28 12:26:45.619837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 253/507] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:45 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:45.687648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "name": "network-vif-plugged", "status": "completed", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:45.700230 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.700959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.701430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.713111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] Creating event network-vif-plugged:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:26:45.718267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-3f2289b8-0ebf-407c-8c96-68a9659a2966 req-4b7e7897-fcb0-4990-a246-580dfe5daaf7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Sep 28 12:26:45.719039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 255/508] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:26:46.098025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:46.098655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:46.104678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.105196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.105637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.106329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.106782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.107202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.240938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:46.248577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1788d66b-aa4d-4f31-a00f-6563491d56fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.155437 Sep 28 12:26:46.249199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 254/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:46 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:46.361350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bf4bcb-fcb0-4571-ab62-a01a701e27aa", "tag": "1f3e04c1-ffca-4137-b169-3bf2fa937308"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:46.371642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.372118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.372550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.383841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] Creating event network-changed:1f3e04c1-ffca-4137-b169-3bf2fa937308 for instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa on hv-cinder-84456 Sep 28 12:26:46.388673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-9ff8be8a-42b2-4281-a13d-bd67680e80fc req-80171e06-d16c-4de1-b142-b859d9bffd59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031350 Sep 28 12:26:46.389302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 256/510] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:46.644202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:46.644983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:46.650901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.651591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.652106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.652806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.653324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.653752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.788615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:46.797218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:46.798666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:46.799867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2c3704f0-d01c-460b-9f00-4472e176e6fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1744 microversion: 2.20 time: 0.159772 Sep 28 12:26:46.801173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 255/511] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:46 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:47.273150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:47.273985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:47.280307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.280817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.281288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.281997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.282534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.283486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.436221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:47.444853 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b445db26-e2ee-4139-b621-f9f0085adaed tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.176079 Sep 28 12:26:47.445450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 257/512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:47 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:47.826797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:47.827402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:47.834759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.835236 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.835737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.836949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.837752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.838183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.990624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:48.000240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:48.002068 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:48.003484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed273d23-8be2-451a-81fe-86618d3e05ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.181055 Sep 28 12:26:48.004046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 256/513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:47 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:48.468356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:48.469237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:48.476260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:48.476701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:48.477165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:48.477872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:48.478499 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:48.479118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:48.627998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:48.636393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-789b4c9d-559c-4e76-9482-5e8813f7658d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.171851 Sep 28 12:26:48.645914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 258/514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:48 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:49.035053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:49.035861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:49.043614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.044104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.044544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.045385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.045842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.046268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.202144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:49.213799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:49.215488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:49.216837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6e743a0c-26ff-45cb-85e7-431a50a26829 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.186263 Sep 28 12:26:49.217807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 257/515] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:49 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:49.664599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:49.665238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:49.671730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.672401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.673023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.673752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.674208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.674657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.825348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:49.834016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a72bff0f-2edb-4f5c-9d89-fe894278a9fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.173362 Sep 28 12:26:49.834799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 259/516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:49 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:26:50.246075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:50.246714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:50.254161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.254782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.255225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.255956 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.256411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.256836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.403203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:50.412098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:50.413822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:50.414972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3fd0a4a-b7dc-49b9-99ba-3756db116651 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.172967 Sep 28 12:26:50.415531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 258/517] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:50 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:50.859265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:50.860046 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:50.877629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.878665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.879411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.880390 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.881438 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.882118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:51.066885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:51.078683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8972a0a1-8d12-46fb-998c-8a7b6d620d69 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.223397 Sep 28 12:26:51.079279 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 260/518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:50 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:51.439931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:51.440721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:51.447244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:51.447730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:51.448182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:51.449314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:51.449896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:51.450429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:51.600636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:51.609539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:51.611351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:51.613249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2996d5ff-e4c5-4abe-9d07-e834ce28a1c7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.176790 Sep 28 12:26:51.614088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 259/519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:51 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:52.103098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:52.103741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:52.110941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.111701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.112395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.113343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.113824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.114287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.257076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:52.266275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-417f5682-cd19-4bd8-a29b-496b5997f9cd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.167143 Sep 28 12:26:52.266851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 261/520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:52 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:52.642679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:52.646555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:52.653821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.654441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.654880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.655580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.656036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.656461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.792856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:52.802126 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:52.803898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:52.805072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d2f53ff8-db7e-45ee-ab91-af848ad83e5c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.166425 Sep 28 12:26:52.805860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 260/521] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:52 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:53.292003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:53.292734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:53.299716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.300310 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.300998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.301726 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.302187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.302612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.440427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:53.450111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3e684ea8-ff86-4087-ab6a-7c4f5fa79773 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.162108 Sep 28 12:26:53.465473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 262/522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:53 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:53.831790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:53.833618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:53.840553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.841035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.841530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.842215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.842661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.843078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.983974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:53.993070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:53.994531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:53.995684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bc600974-199c-4c8a-be81-0aa71065cab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.168190 Sep 28 12:26:53.996233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 261/523] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:53 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:26:54.476612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:54.478766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:54.489899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:54.491123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:54.491903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:54.492723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:54.494104 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:54.494675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:54.639906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:54.648162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-294374d0-973d-4222-b1cc-66a8d2f105fd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.177063 Sep 28 12:26:54.648753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 263/524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:54 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:55.022766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:55.023326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:55.029698 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.030441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.031052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.031977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.032768 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.033424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.170283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:55.180614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:55.183503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:55.184895 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e8deb63-429f-4926-bacd-7e48fc93a5a2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.167215 Sep 28 12:26:55.196399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 262/525] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:55 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:55.673335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:55.673978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:55.681394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.682226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.682885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.683830 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.684489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.685163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.824022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:55.831972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c27ccff2-f990-43e6-87df-075a74642d43 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.162490 Sep 28 12:26:55.832541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 264/526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:55 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:56.217530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:56.219108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:56.230441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.230932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.231365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.232108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.232789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.233225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.380730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:56.390006 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:56.391301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:56.392508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f16be324-917a-48d2-abfb-65fd13469c63 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.185694 Sep 28 12:26:56.409310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 263/527] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:56 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:56.857760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:56.859068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:56.866442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.867151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.867774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.868482 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.869201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.869630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.888560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:57.009173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:57.017489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-391f4c84-e5d0-4e33-928b-19aa5ac9d297 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.163392 Sep 28 12:26:57.022061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 265/528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:56 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:57.420234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:57.420843 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:57.430622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:57.431119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:57.431561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:57.432286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:57.432748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:57.433197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:57.445933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:57.667237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:57.675661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:57.677178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:57.678352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a2e0e79c-6e9a-4e16-a416-f0c4954d83ba tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.262865 Sep 28 12:26:57.678907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 264/529] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:57 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:58.046224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:58.048809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:58.062670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.064297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.065022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.065864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.066831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.067268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.217163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:58.225822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b3e4c76d-67d3-41f3-952b-29d3ef8188bf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.183372 Sep 28 12:26:58.226420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 266/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:58 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:58.706055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:58.706706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:58.712978 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.713490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.713950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.714627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.715068 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.715487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.919495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:58.928182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:58.929499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:58.930640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-750dedf9-6c17-4b27-90d3-fde857f0d5b1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1739 microversion: 2.20 time: 0.228421 Sep 28 12:26:58.931189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 265/531] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:58 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:26:59.250683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:59.251299 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.257883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.258372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.258809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.259498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.259953 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.260386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.386921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:59.395893 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bab4af72-a7a9-46d5-bf5e-fee7d33f1cbe tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1501 microversion: 2.1 time: 0.149081 Sep 28 12:26:59.396592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 267/532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:59 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:59.419817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e69e47e-5310-4865-9090-f0feb259ed85"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:59.426709 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.432739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.433254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.433680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.434355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.434798 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.435207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.459172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] HTTP exception thrown: Cannot 'attach_volume' instance 2b649038-e0a8-45a6-a118-534dcc182549 while it is in vm_state rescued Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Request method failure captured: Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/os-volume_attachments HTTP/1.1 Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 74 Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND0LhbExAQy4KLw-LCRTeclNrN0KrkDLKbxwK5o7vyXZnkbKeoXLXKdJ_4-jFrIP70ladAnu4H0KQPKqDrwR20CKR2j4oMyUZTL42O_9ScJ8OsFbyu5AD8Lx1hxe7w96_HMX6iyy61xDmghWVdIa5MtwFGMKeeyj-pkeVj0X37MVf-E Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:26:59.461383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1318535cbbd6427c8c770bd5b256ac3e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}] Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: cc96808ff3fb41f085f09aa943c3d016 Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {"volumeAttachment": {"volumeId": "8e69e47e-5310-4865-9090-f0feb259ed85"}} Sep 28 12:26:59.462813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Cannot 'attach_volume' instance 2b649038-e0a8-45a6-a118-534dcc182549 while it is in vm_state rescued Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'server_id': '2b649038-e0a8-45a6-a118-534dcc182549', 'body': {'volumeAttachment': {'volumeId': '8e69e47e-5310-4865-9090-f0feb259ed85'}}} Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2b649038-e0a8-45a6-a118-534dcc182549 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:26:59.463594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2b649038-e0a8-45a6-a118-534dcc182549 while it is in vm_state rescued Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:26:59.464757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2b649038-e0a8-45a6-a118-534dcc182549 while it is in vm_state rescued Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Returning 409 to user: Cannot 'attach_volume' instance 2b649038-e0a8-45a6-a118-534dcc182549 while it is in vm_state rescued {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24b58529-c263-432c-8330-f29a7739d568 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047642 Sep 28 12:26:59.466483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 266/533] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:26:59 2022] POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 12:26:59.473377 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:26:59.473901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.480012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.480500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.480937 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.481659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.482116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.482540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.547943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1475f1c1-795b-4bc3-b450-c27d2b8a8c3f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/action" status: 202 len: 0 microversion: 2.1 time: 0.079226 Sep 28 12:26:59.548578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 268/534] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:26:59 2022] POST /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:26:59.556748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:59.557395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.563747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.564221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.564652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.565368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.565861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.566342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.695071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:26:59.702667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8978e109-f420-48b9-9173-77441dcc6c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.149842 Sep 28 12:26:59.703222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 267/535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:26:59 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:26:59.957323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:59.957942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.964114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.964596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.965027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.965736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.966192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.966615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:00.097066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:00.105013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:00.106468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:00.107607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8029e9f1-8793-41f9-af25-1cf99d9333fa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1721 microversion: 2.20 time: 0.155281 Sep 28 12:27:00.108161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 269/536] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:26:59 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:00.727684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:00.728949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:00.735479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:00.735962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:00.736397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:00.737086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:00.737561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:00.737981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:00.961183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:00.968671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ef039782-7e54-4fa5-8d79-22223bf5bb1e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.244810 Sep 28 12:27:00.969247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 268/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:00 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:01.135486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:01.136730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:01.144907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.145870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:01.146529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:01.147508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.148217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:01.149116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:01.594998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:01.603457 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:01.605965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:01.607132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6e2b5c9e-5fdd-4109-97fc-27bb10417c22 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1721 microversion: 2.20 time: 0.476670 Sep 28 12:27:01.614681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 270/538] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:01 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1721 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:27:01.714681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "name": "network-vif-unplugged", "status": "completed", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:01.724569 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.725050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:01.725523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:01.736700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] Creating event network-vif-unplugged:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:27:01.742188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b75611ab-98df-4633-a6a9-02c596a072ae req-57e4e83b-0f74-4351-ae3c-88310b25d8c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031183 Sep 28 12:27:01.742771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 269/539] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:01.992553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:01.993176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:01.999086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.999568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.000119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.000807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:02.001289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.001818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.127876 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:02.135491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1054d354-8164-42c4-9109-4efad0cbc611 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.146761 Sep 28 12:27:02.136076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 271/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:01 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:27:02.633433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:02.634124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:02.640147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:02.640625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.641060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.641764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:02.642211 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.642635 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.773477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:02.781468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:02.782904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:02.784041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-28ecfdd4-606a-4875-8615-3c58949e5380 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1721 microversion: 2.20 time: 0.154876 Sep 28 12:27:02.784634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 270/541] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:02 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:03.160367 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:03.161698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:03.168439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.168915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.169393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.170082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.170530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.170944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.304466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:03.312143 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7fb51725-69da-45b1-a5a9-bfe4f873f263 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.155953 Sep 28 12:27:03.312704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 272/542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:03 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:03.811155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:03.811686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:03.818705 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.819161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.819590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.820271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.820720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.821156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.950393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:03.958488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:03.959910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:03.961048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0bce51d9-8b3a-4f97-a468-5437bbf7c2a9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1724 microversion: 2.20 time: 0.154805 Sep 28 12:27:03.961654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 271/543] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:03 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:03.985500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d05429-fb68-49cb-937a-98d9dbd1a528"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:03.988434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:03.994212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.994691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.995120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.995801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.996246 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.996660 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.270220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-02d4f0fa-946a-4165-a92a-33510a3b8df3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288649 Sep 28 12:27:04.273777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 273/544] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 28 12:27:03 2022] POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:27:04.335165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:04.335807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:04.341614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.342160 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.342585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.343268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.343714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.344129 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.395722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:04.396342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:04.402479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.402963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.403393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.404086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.404540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.404963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.449561 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120393) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 12:27:04.477252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:04.484909 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a19bbb0-733b-42a8-bf8b-6ffd27b9c04c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.153555 Sep 28 12:27:04.485497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 272/545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:04 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:04.517263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ec278e05-d0d7-4ef6-ac9d-95c2e0faea89 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/action" status: 202 len: 0 microversion: 2.20 time: 0.125370 Sep 28 12:27:04.517773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 274/546] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 12:27:04 2022] POST /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:27:04.526404 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:04.527013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:04.532913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.533500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.533949 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.535215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.535766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.536189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.668389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:04.677694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:04.679146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:04.680306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ec8cddc3-b1a3-4236-a6bc-f1d2845545cf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1810 microversion: 2.20 time: 0.157826 Sep 28 12:27:04.680871 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 273/547] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:04 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:27:05.508882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:05.509536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:05.515334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.515809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.516239 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.516913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.517392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.517809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.642106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:05.649819 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-946b2e91-a10d-4508-aec4-d60574b8fc2d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1509 microversion: 2.1 time: 0.145273 Sep 28 12:27:05.650376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 275/548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:05 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:05.704982 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:05.705634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:05.711932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.712406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.713043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.713758 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.714210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.714632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.847270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:05.855953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:05.857563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:05.858717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5ea62044-586f-4ac2-a847-396ffc6e62ca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1810 microversion: 2.20 time: 0.157671 Sep 28 12:27:05.859262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 274/549] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:05 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:06.673460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:06.674078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:06.681538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.682080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.682547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.683237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.683693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.684113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.815799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:06.823375 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5bc33716-9010-4a87-9c43-f7ae5fd9f8fc tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1515 microversion: 2.1 time: 0.153699 Sep 28 12:27:06.823951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 276/550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:06 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:06.884703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:06.886178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:06.892739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.893256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.894198 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.894945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.895464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.895890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:07.041087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:07.051720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:07.054001 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:07.055569 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d1d7f3cc-faea-44d5-aa62-9175b4325aff tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1750 microversion: 2.20 time: 0.174884 Sep 28 12:27:07.063761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 275/551] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:06 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:08.082315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:08.082899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:08.089381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:08.089866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:08.090301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:08.090983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:08.091436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:08.091894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:08.110125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:08.227088 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:08.228501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4c49f48f-59bd-4192-bbaf-e3e716414b29 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: .version_select at 0x7fa706c0f0d0>, body: {"keypair": {"name": "tempest-keypair-783736508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoUiE6MJSWO342PIs8oTieXjQImmxzWq3b/4Jvgu+UceBHLsoImVHPSF471wnYsyTqzm+I6zAvcfAs3TN0PjDnkSk/kISXtmgI/5VgQermVdpsqJtLgHQ0NsW8Y+XY75Q=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:08.235778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:08.237441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:08.238850 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4af4c315-171b-4da3-9750-e31db49ec343 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1752 microversion: 2.20 time: 0.160334 Sep 28 12:27:08.239397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 277/552] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:08 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:08.243964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4c49f48f-59bd-4192-bbaf-e3e716414b29 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:27:08.247793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4c49f48f-59bd-4192-bbaf-e3e716414b29 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for user cc96808ff3fb41f085f09aa943c3d016 and project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:27:08.268462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4c49f48f-59bd-4192-bbaf-e3e716414b29 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043780 Sep 28 12:27:08.269719 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 276/553] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:27:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:27:09.264536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:09.265384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:09.272671 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:09.273271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:09.273779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:09.274492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:09.274946 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:09.275395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:09.469980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:09.479326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:09.480949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:09.482493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1bf7196f-be92-4b11-9d64-4f40c1ab505c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.221825 Sep 28 12:27:09.483333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 278/554] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:09 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:09.598291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1188417585", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d22fae6b-c19d-4165-8f58-a67d0afa1461"}], "security_groups": [{"name": "tempest-securitygroup--989675566"}], "key_name": "tempest-keypair-783736508", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:09.703533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] validate_networks() for [('d22fae6b-c19d-4165-8f58-a67d0afa1461', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:27:10.093093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:27:10.093551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:27:10.094024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:27:10.094437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:27:10.094842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:27:10.104235 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.104720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.105178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.105903 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.106355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.106774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.123919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:27:10.128623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Getting quotas for user cc96808ff3fb41f085f09aa943c3d016 and project 1318535cbbd6427c8c770bd5b256ac3e. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:27:10.139510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:27:10.141819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:27:10.194617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38004120-c749-4c6f-9ea9-d7f783c2cd95 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.601229 Sep 28 12:27:10.195468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 277/555] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:27:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:27:10.207328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0e11a1fd-2d5d-45dd-98fd-77767e6d560e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:10.208023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0e11a1fd-2d5d-45dd-98fd-77767e6d560e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:10.265801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0e11a1fd-2d5d-45dd-98fd-77767e6d560e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:10.274658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0e11a1fd-2d5d-45dd-98fd-77767e6d560e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1245 microversion: 2.1 time: 0.071985 Sep 28 12:27:10.275392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 279/556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:10 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:10.514425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:10.515360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:10.528071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.529093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.530019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.531398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.532159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.538228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.705876 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:10.716984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:10.718711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:10.719904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8fd75162-5cbc-47be-948d-8d7549a59d55 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.210203 Sep 28 12:27:10.720458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 278/557] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:10 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:11.303199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:11.303808 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:11.311005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.311489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.311922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.312650 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.313100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.313544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.376101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:11.384562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c5b5ebcd-75c8-454b-abf3-d059ff819fe9 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.086107 Sep 28 12:27:11.385148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 280/558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:11 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:11.746586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:11.747184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:11.753552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.754027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.754462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.755145 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.755598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.756018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.890800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:11.899851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:11.901317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:11.902473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-166d4afc-4dae-4db9-950f-2f3c1fbadc3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.159754 Sep 28 12:27:11.903029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 279/559] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:11 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:12.408174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:12.408931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:12.417617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.418126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.418640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:12.419433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.419911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.420409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:12.484750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:12.493151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e504e890-514c-4614-a2c8-02643aa44669 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.088809 Sep 28 12:27:12.493807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 281/560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:12 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:12.928614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:12.929259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:12.935600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.936081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.936509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:12.937222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.937676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.938096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.069190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:13.078106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:13.079652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:13.080972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d7a03613-85b6-4dc2-9796-770cb361f586 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.156807 Sep 28 12:27:13.081751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 280/561] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:12 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:13.517452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:13.518145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:13.520929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:13.525867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.526360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.526869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.527675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.528281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.528768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.592005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:13.600748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5433b67a-a613-4003-9d2d-832979e6fe7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.087201 Sep 28 12:27:13.601343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 282/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:13 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:14.108714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:14.109508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:14.116817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:14.117355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:14.117797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:14.118503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:14.118957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:14.119407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:14.252465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:14.262105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:14.263553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:14.264703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e12d5bf7-8b08-4bed-9c4d-8bf634517e41 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.160621 Sep 28 12:27:14.265448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 281/563] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:14 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:14.623841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:14.624740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:14.632709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:14.633223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:14.633656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:14.634356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:14.634802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:14.635222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:14.704912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:14.714667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ce6b778f-73c0-48ca-8148-f11647478413 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.094604 Sep 28 12:27:14.715433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 283/564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:14 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:15.290445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:15.291121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:15.294008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:15.299301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:15.299789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:15.300220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:15.301069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:15.301736 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:15.303328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:15.445860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:15.454665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:15.456089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:15.457268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fb49da0a-89d7-428c-a4db-bf7986d702d3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.171252 Sep 28 12:27:15.457817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 282/565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:15 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:15.739381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:15.740879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:15.747766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:15.748257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:15.748697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:15.749433 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:15.749895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:15.750366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:15.812966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:15.820935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-75d5a2fe-337e-4642-ba6b-6861f49988c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.085417 Sep 28 12:27:15.821554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 284/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:15 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:16.483511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:16.484124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:16.491221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:16.491707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:16.492139 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:16.492835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:16.493341 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:16.493763 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:16.517494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:16.627817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:16.637361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:16.638802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:16.639960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aec8a9a1-643c-4e09-af7d-fbcc2f77b4be tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.160312 Sep 28 12:27:16.640516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 283/567] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:16 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:27:16.843815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:16.844395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:16.851575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:16.852054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:16.852482 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:16.853184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:16.853636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:16.854056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:16.914757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:16.923315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ffec6bec-10d0-477f-883b-e5d0df8a444f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.083346 Sep 28 12:27:16.924078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 285/568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:16 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:17.667269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:17.667885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:17.674206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:17.674680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:17.675110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:17.675787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:17.676252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:17.676652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:17.948042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:17.948878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:17.955867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:17.956453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:17.957041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:17.957618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:17.958324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:17.959215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:18.024031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:18.032241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-35284b43-0bad-426e-84b8-e115585bff03 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.087922 Sep 28 12:27:18.041487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 286/569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:17 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:27:18.063410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:18.072835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:18.076818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:18.078109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ae8e1330-4ff0-42b2-a6a1-30db6cdc2054 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.414646 Sep 28 12:27:18.079053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 284/570] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:17 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:19.056068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:19.056677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:19.063252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:19.063740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:19.064177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:19.064878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:19.065367 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:19.065792 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:19.103913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:19.105677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:19.112324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:19.112884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:19.113417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:19.114172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:19.114685 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:19.115869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:19.130825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:19.139233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4e6f7f6e-8720-4b3e-b865-4151c6f50479 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.087473 Sep 28 12:27:19.139806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 287/571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:19 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:19.255153 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:19.266151 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:19.267586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:19.268737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99b40c90-eca8-4928-b9c0-1aa99d060a71 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.168771 Sep 28 12:27:19.269352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 285/572] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:19 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:27:20.162652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:20.163372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:20.170724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:20.171218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:20.171654 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:20.172489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:20.173061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:20.173570 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:20.241529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:20.249079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e264d9a-50d4-438b-b9a8-259a98ce7d78 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.090587 Sep 28 12:27:20.249690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 288/573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:20 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:20.294697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:20.295280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:20.297630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:20.298304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:20.304699 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:20.305231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:20.306089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:20.306345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:20.306823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:20.307208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:20.446741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:20.457083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:20.459143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:20.460634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3be35ee5-c83b-47a7-8ddb-2c398abdba86 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.170102 Sep 28 12:27:20.461207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 286/574] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:20 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:21.273507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:21.274148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:21.276019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:21.281849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:21.282327 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:21.282751 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:21.283436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:21.283883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:21.284323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:21.347077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:21.355174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-96377151-d7cf-4e1b-93db-5ba4f19969a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.085822 Sep 28 12:27:21.355738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 289/575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:21 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:21.487578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:21.488199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:21.495201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:21.495677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:21.496103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:21.496779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:21.497254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:21.497671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:21.631400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:21.640448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:21.641955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:21.643118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2b63d799-55cb-45d4-9c22-005bd2855cd0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.159491 Sep 28 12:27:21.643680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 287/576] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:21 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:27:22.378952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:22.379559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:22.386489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:22.386967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:22.387402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:22.388084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:22.388536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:22.388957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:22.452455 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:22.460538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5eeefa0b-4011-4df7-a170-99f93084419c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.085436 Sep 28 12:27:22.461108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 290/577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:22 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:22.667945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:22.668577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:22.675072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:22.675552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:22.675985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:22.676668 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:22.677796 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:22.678226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:22.808062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:22.816475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:22.817969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:22.819117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-05f9120b-a973-4815-8de0-58839ebcba7c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.155026 Sep 28 12:27:22.819663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 288/578] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:22 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:23.483777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:23.484389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:23.491214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:23.491704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:23.492143 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:23.492841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:23.493333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:23.493763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:23.558551 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:23.566218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-238065a3-f8a5-4a71-ae1f-b03e8a4c4dc7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.086349 Sep 28 12:27:23.566782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 291/579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:23 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:23.843853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:23.844518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:23.851213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:23.851691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:23.852134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:23.852819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:23.853301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:23.853724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:23.982592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:23.991776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:23.993231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:23.994369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-98604b46-7606-4e49-9bf7-dfc2f944489e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.154430 Sep 28 12:27:23.994921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 289/580] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:23 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:24.588484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:24.589062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:24.595460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:24.596197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:24.596626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:24.597408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:24.597860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:24.598280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:24.658067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:24.666038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0e200308-0ac7-4207-8282-6721b0ccf621 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.081379 Sep 28 12:27:24.666597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 292/581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:24 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:25.020016 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:25.020619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:25.027626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:25.028104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:25.028542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:25.029256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:25.029715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:25.030138 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:25.155092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:25.164157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:25.179485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:25.180919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6a01a496-b44b-45a6-a062-c3b27cac103d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.164834 Sep 28 12:27:25.181794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 290/582] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:25 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:25.688911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:25.689552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:25.696616 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:25.697108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:25.697584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:25.698274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:25.698733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:25.699157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:25.758928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:25.766434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0ba300ad-8330-42e2-8fc4-e33cfbfa9d19 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.081392 Sep 28 12:27:25.766999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 293/583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:25 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:26.220208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:26.221218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:26.230340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:26.230814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:26.231241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:26.231932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:26.232374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:26.232790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:26.366271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:26.374659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:26.376078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:26.377226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d591ab5d-b44d-417d-bc68-9ee95a3d75cd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.162654 Sep 28 12:27:26.377775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 291/584] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:26 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:26.789552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:26.790180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:26.796547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:26.797057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:26.797507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:26.798194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:26.798650 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:26.799075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:26.858632 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:26.866644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d2610636-2944-4634-b698-2ca00a13f79b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1249 microversion: 2.1 time: 0.080913 Sep 28 12:27:26.867218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 294/585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:26 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:27.402503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:27.403018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:27.409407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:27.409889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:27.410352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:27.411039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:27.411493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:27.412451 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:27.540454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:27.550924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:27.552362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:27.554077 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-caa19e5b-bafa-4bcf-bdfb-ec4c9d96e96e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.155493 Sep 28 12:27:27.554631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 292/586] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:27 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:27.890196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:27.890812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:27.898014 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:27.898498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:27.898932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:27.899620 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:27.900072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:27.900489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:27.904473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:27.973092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:27.981384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-dd7430c1-b551-49aa-96a8-925aca89e82d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1303 microversion: 2.1 time: 0.095159 Sep 28 12:27:27.981954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 295/587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:27 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:28.579123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:28.579758 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:28.586260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:28.586738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:28.587171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:28.587861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:28.588306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:28.588722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:28.724964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:28.733674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:28.735106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:28.736250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-229f46c9-306d-4819-8d54-48a79c16628c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.161111 Sep 28 12:27:28.736808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 293/588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:28 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:29.004991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:29.005866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:29.012552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:29.013052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:29.013626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:29.014331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:29.014801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:29.015228 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:29.216815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:29.225588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e8ba3e0-b1e8-4592-ad4c-4766776bbb5d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.224623 Sep 28 12:27:29.226521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 296/589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:28 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:29.323699 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:29.334601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:29.336187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:29.336664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:29.348403 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] Creating event network-changed:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:27:29.354392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-7476cade-cb71-4c96-9653-846ac4dcebac req-f078f951-000c-4803-8566-3f77e0774e45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035812 Sep 28 12:27:29.354986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 294/590] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:29.762042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:29.762554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:29.768512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:29.768875 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:29.769353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:29.770232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:29.770898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:29.772199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:29.904696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:29.913225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:29.914880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:29.916225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-39ecedfe-45d0-40bd-85a1-1545e8e3b1b4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.158107 Sep 28 12:27:29.916872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 297/591] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:29 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:30.250062 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:30.250752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:30.257719 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:30.258200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:30.258634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:30.259324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:30.259777 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:30.260201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:30.389121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:30.396615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c525e103-2faf-407d-8445-dec9f9786741 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.151092 Sep 28 12:27:30.397196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 295/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:30 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:30.941706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:30.942314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:30.948424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:30.948916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:30.949363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:30.950040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:30.950488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:30.950906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:31.075838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:31.084930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:31.086409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:31.087555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3abb66e8-d424-4558-96ad-41e007e98395 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.149695 Sep 28 12:27:31.088112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 298/593] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:30 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:31.420130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:31.420676 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:31.427019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:31.428055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:31.428592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:31.429326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:31.429769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:31.430189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:31.554579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:31.562043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a08c6f2-b872-4cde-98de-a6614a6d6ba2 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.145979 Sep 28 12:27:31.562603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 296/594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:31 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:32.112649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:32.113283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:32.120212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:32.120687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:32.121115 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:32.121813 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:32.122261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:32.122677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:32.254836 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:32.263490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:32.264933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:32.266110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c71a2ff6-3e99-4fd3-aa91-3c508a8abd8c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.157404 Sep 28 12:27:32.266669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 299/595] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:32 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:32.585914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:32.586525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:32.592866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:32.593391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:32.593832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:32.594522 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:32.594981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:32.595407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:32.724319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:32.732139 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0a8c751e-705e-44ba-a798-80f0a089db21 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.150831 Sep 28 12:27:32.732708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 297/596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:32 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:33.291967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:33.292569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:33.299317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:33.299791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:33.300218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:33.300899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:33.301373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:33.301791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:33.427072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:33.436202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:33.437666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:33.438806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a5805fed-a29e-4f2e-8b8d-d75e9984ab14 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.150676 Sep 28 12:27:33.439349 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 300/597] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:33 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:33.755090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:33.755838 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:33.762311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:33.762787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:33.763215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:33.763891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:33.764336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:33.764749 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:33.899033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:33.906892 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-160cf92a-fc70-4e9c-a96a-cc0f4ca15e14 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.155618 Sep 28 12:27:33.907591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 298/598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:33 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:34.464374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:34.465049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:34.472561 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:34.473117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:34.473624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:34.474501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:34.475184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:34.475663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:34.613962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:34.623332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:34.624785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:34.625962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-694ca086-3cee-44d9-a22f-8428c3f7bab7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.165790 Sep 28 12:27:34.626526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 301/599] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:34 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:34.931473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:34.932075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:34.938414 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:34.938884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:34.939309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:34.939984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:34.940430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:34.940849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:35.070852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:35.078476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a0ef3f6-4385-4e93-b8a7-ac10bb55f095 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.151470 Sep 28 12:27:35.079042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 299/600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:34 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:35.652279 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:35.652794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:35.659157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:35.659636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:35.660081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:35.660759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:35.661242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:35.661670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:35.788984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:35.797538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:35.799047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:35.800201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3488eab3-9b77-4cf9-942c-c2a96e5ff5bf tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.151925 Sep 28 12:27:35.800763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 302/601] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:35 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:36.101139 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:36.101986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:36.108436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:36.108924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:36.109395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:36.110083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:36.110534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:36.111042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:36.133771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "name": "network-vif-plugged", "status": "completed", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:36.154321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:36.155843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:36.156348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:36.174951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] Creating event network-vif-plugged:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:27:36.181246 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-8a8f72cb-e6ab-4c4e-8c36-5662d062e218 req-0f68589f-694f-4d5a-9257-78f5776f3b5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051452 Sep 28 12:27:36.183930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 303/602] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:27:36.266783 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:36.271215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:36.276705 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7278d2df-9411-455b-ad4e-6ff812bcef51 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.179494 Sep 28 12:27:36.277292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 300/603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:36 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:36.827232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:36.827915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:36.834743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:36.835220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:36.835647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:36.836318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:36.836765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:36.837198 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:36.966547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:36.975956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:36.977414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:36.978556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1f25620d-b9ea-4812-9431-d592f870305b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.156065 Sep 28 12:27:36.979110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 304/604] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:36 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:37.299737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:37.300375 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:37.306967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:37.307444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:37.307892 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:37.308577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:37.309031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:37.309481 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:37.435729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:37.443233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-30d4a841-558e-43ec-9b40-6a1ae7b06d4a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1370 microversion: 2.1 time: 0.147364 Sep 28 12:27:37.444498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 301/605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:37 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:38.003576 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:38.004187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:38.010510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.010995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.011423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.012129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.012580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.012993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.140651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:38.150129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:38.151517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:38.152671 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-eeeed251-be3d-4431-a2a2-c96e5461453f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.152956 Sep 28 12:27:38.153243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 305/606] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:37 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:38.199666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "name": "network-vif-plugged", "status": "completed", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:38.210742 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.211226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.211661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.223094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] Creating event network-vif-plugged:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:27:38.228983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dad1606b-ffab-4339-8ee3-0ca45b14b08c req-ab9a63c8-159b-4bdf-b14f-89510c08066f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Sep 28 12:27:38.229613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 302/607] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:38.466651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:38.467255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:38.473456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.473934 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.474372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.475699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.476148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.476568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.605806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:38.613476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-44887af6-5d1f-4a18-ab25-cff1f4f8e58e tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1563 microversion: 2.1 time: 0.150535 Sep 28 12:27:38.614036 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 306/608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:38 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:38.637508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:38.638110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:38.644074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.644549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.644984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.645695 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:38.646143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:38.646700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:38.728468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99964d66-9e64-4705-b240-23d08b3318e1 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095586 Sep 28 12:27:38.729064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 303/609] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:27:38 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:27:39.179553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:39.180303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:39.187137 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:39.187620 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:39.188055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:39.188764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:39.189256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:39.189683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:39.334308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:39.344700 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:39.346560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:39.347839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9e68bcff-b358-4b90-818a-93a9635b3862 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.172601 Sep 28 12:27:39.348517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 307/610] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:39 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:39.655633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:39.666153 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:39.666624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:39.667044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:39.678528 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] Creating event network-changed:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:27:39.683840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-46245ef5-a5c1-4356-bf74-dce312d4463b req-560c198b-c6cd-4b46-9973-31544a8df8bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032333 Sep 28 12:27:39.684453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 304/611] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:27:40.375011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:40.375611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:40.382206 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:40.382693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:40.383121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:40.383817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:40.384269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:40.384687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:40.523435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:40.532424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:40.533983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:40.535346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e6b0ea51-57f6-4ef8-8bbb-375ba7471aae tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.164259 Sep 28 12:27:40.536110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 308/612] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:40 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:41.561741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:41.562425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:41.569361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:41.569836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:41.570270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:41.570950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:41.571398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:41.571815 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:41.750756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:41.759319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:41.760760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:41.761953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2d4b9f0f-9653-4e8f-908e-c13f01f6b7b8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1808 microversion: 2.20 time: 0.204524 Sep 28 12:27:41.762506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 305/613] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:41 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:42.787109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:42.787716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:42.794502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:42.795063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:42.795516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:42.796278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:42.796763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:42.797216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:42.974567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:42.983663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:42.985086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:42.986248 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6332c1e5-7b92-4cc7-a174-62ed63536bca tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1795 microversion: 2.20 time: 0.203060 Sep 28 12:27:42.986792 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 309/614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:27:42 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1795 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:27:54.770150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:54.772549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:54.775190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=47 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:54.775866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=20 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:54.782248 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:54.782731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:54.783167 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:54.783862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:54.784313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:54.784733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:54.857776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0348760e-8ad7-4fac-a41c-f4ca5bc37ab3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action" status: 202 len: 0 microversion: 2.1 time: 0.091235 Sep 28 12:27:54.858584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 306/615] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:27:54 2022] POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:27:54.867958 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:54.868647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:54.871333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=55 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:54.872108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=84 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:54.877625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:54.878108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:54.878568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:54.879269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:54.879720 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:54.880177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:55.072808 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:55.081765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f0719e36-7453-4582-9f51-6a89a7dd4c1a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1751 microversion: 2.1 time: 0.218811 Sep 28 12:27:55.082334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 310/616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:54 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:56.105916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:56.106612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:56.113085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:56.113594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:56.114024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:56.114706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:56.115154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:56.115573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:56.259840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:56.268086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-342fafb5-66ac-465c-8529-350f995062fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.166383 Sep 28 12:27:56.268657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 307/617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:56 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:57.291633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:57.292244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:57.298638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:57.299120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:57.299554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:57.300239 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:57.300693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:57.301112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:57.441874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:57.450586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fd37f54e-c0e9-42a6-8a19-761829d91eb3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.162810 Sep 28 12:27:57.451149 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 311/618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:57 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:58.474689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:58.475416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:58.482029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:58.482503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:58.482934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:58.483613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:58.484063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:58.484482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:58.622892 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:58.631119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b5d06924-dbe3-4717-8729-2bb3cf0a06f3 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.160861 Sep 28 12:27:58.631684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 308/619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:58 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:27:59.655465 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:59.656082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:59.662493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:59.663004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:59.663431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:59.664109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:59.664557 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:59.664975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:59.801416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:27:59.812267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-acc05c5d-d620-4c37-8172-19366cda1fec tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.160798 Sep 28 12:27:59.812911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 312/620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:27:59 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:00.837473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:00.838079 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:00.844078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:00.844561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:00.844993 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:00.845950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:00.846402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:00.846823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:00.994133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:01.003081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6eb4d69-bb43-4601-9606-4b2392ce33dd tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.169784 Sep 28 12:28:01.003712 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 309/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:00 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:02.026961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:02.027566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:02.033546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:02.034025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:02.034449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:02.035126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:02.035576 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:02.035993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:02.176204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:02.184801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b1512ce4-9650-4f52-8670-02cf338fb59b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.161794 Sep 28 12:28:02.185598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 313/622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:02 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:03.207780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:03.208379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:03.215041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:03.215514 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:03.215952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:03.216626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:03.217069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:03.217509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:03.359257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:03.368018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c658907d-3b9c-4443-a0e9-a97a58e34346 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.164053 Sep 28 12:28:03.368587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 310/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:03 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:04.391380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:04.391981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:04.398497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:04.398970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:04.399401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:04.400081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:04.400534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:04.400953 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:04.536613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:04.545581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6e69e638-35a0-4e28-a2fd-73bf408ea915 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.157605 Sep 28 12:28:04.546633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 314/624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:04 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:05.570389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:05.570972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:05.577790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:05.578264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:05.578700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:05.579377 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:05.579825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:05.580246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:05.722153 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:05.730262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4bd4d065-2a50-4c5c-9f28-2603550ec372 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.164284 Sep 28 12:28:05.730851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 311/625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:05 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:06.753545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:06.754159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:06.760861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:06.761385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:06.761818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:06.762511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:06.762977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:06.763436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:06.903950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:06.912125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-06084d7d-3de4-47da-b33f-a4d95b788f8c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1756 microversion: 2.1 time: 0.162448 Sep 28 12:28:06.912693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 315/626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:06 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:07.936188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:07.936858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:07.943490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:07.943979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:07.944419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:07.945512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:07.945976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:07.946400 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:08.086618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:08.094789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e3d494c-f699-4d43-a571-8d23b1f8e1fc tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1759 microversion: 2.1 time: 0.162473 Sep 28 12:28:08.095607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 312/627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:07 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:28.544369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:28:28.544955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Wed Sep 28 12:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/ips (ip 10.222.0.60) !!! Sep 28 12:28:28.546473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=12 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:28.547221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=36 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:28.648738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:28.649261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:28.655825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.656306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.656737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.657452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.657912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.658335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.681549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-36716918-924a-414b-9a51-c4ca7d1e7868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/ips" status: 200 len: 150 microversion: 2.1 time: 0.142508 Sep 28 12:28:28.682100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 316/628] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:28:28 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/ips => generated 150 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:28.693798 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd95400b-9bae-4237-bd5e-a83f9f444b9d"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:28.696335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:28.698929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=14 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:28.699600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:28.705512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.705999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.706492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.707244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.707717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.708147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.791860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/os-volume_attachments HTTP/1.1 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 74 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:28:28.793595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {"volumeAttachment": {"volumeId": "bd95400b-9bae-4237-bd5e-a83f9f444b9d"}} Sep 28 12:28:28.795241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'server_id': '52bf4bcb-fcb0-4571-ab62-a01a701e27aa', 'body': {'volumeAttachment': {'volumeId': 'bd95400b-9bae-4237-bd5e-a83f9f444b9d'}}} Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:28:28.796209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:28.797553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 400 to user: Invalid volume: volume bd95400b-9bae-4237-bd5e-a83f9f444b9d is already attached to instances: 58f4d7a5-a42f-4ce7-bf29-b689265cceba {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0154b9e2-2e2b-48b6-b8cf-674935352155 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105206 Sep 28 12:28:28.798743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 313/629] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:28:28 2022] POST /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:28:28.804032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:28.805256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:28.811220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.811690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.812186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.812818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.813325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.813742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.837777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:28:28.911638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7f7aa717-82bd-47f2-9428-ca4e6b6ec578 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 204 len: 0 microversion: 2.1 time: 0.110941 Sep 28 12:28:28.912032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 317/630] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:28:28 2022] DELETE /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:28:28.924155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:28.924763 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:28.933418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.933954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.934421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:28.935113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:28.935561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:28.935985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:29.066243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:29.073988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b22024d0-f6ca-49c8-b175-3327afae2c27 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1681 microversion: 2.1 time: 0.155408 Sep 28 12:28:29.074544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 314/631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:28 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:30.098546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:30.099229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:30.105540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:30.106012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:30.106439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:30.107116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:30.107564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:30.107985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:30.240501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:30.248725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-297d99eb-8d60-461a-a084-f1a668c0c63a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1681 microversion: 2.1 time: 0.154692 Sep 28 12:28:30.249318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 318/632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:30 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:31.271296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:31.271994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:31.278626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:31.279111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:31.279539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:31.280230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:31.280681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:31.281100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:31.409732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:31.417447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c362a508-2cc1-4536-afad-7f12e8cba6cf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1681 microversion: 2.1 time: 0.150079 Sep 28 12:28:31.418221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 315/633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:31 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:32.011810 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf4bcb-fcb0-4571-ab62-a01a701e27aa", "name": "network-vif-deleted", "tag": "1f3e04c1-ffca-4137-b169-3bf2fa937308"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:32.022062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:32.022749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:32.024167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:32.035600 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] Creating event network-vif-deleted:1f3e04c1-ffca-4137-b169-3bf2fa937308 for instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa on hv-cinder-84456 Sep 28 12:28:32.041017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-b295a314-a1f2-4aa1-9b9b-2e25e05d2050 req-69a14e26-1e66-4902-8667-2774448b5f0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093199 Sep 28 12:28:32.042167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 319/634] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:32.440782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:32.441515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:32.449218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:32.449713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:32.450171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:32.450901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:32.451356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:32.451834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:32.485124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:32.485638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:32.486078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:32.486529 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lazy-loading 'fault' on Instance uuid 52bf4bcb-fcb0-4571-ab62-a01a701e27aa {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:28:32.528778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:32.536999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-436ccc37-cc7b-4a0a-af5c-39aabf726392 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 200 len: 1330 microversion: 2.1 time: 0.100164 Sep 28 12:28:32.537849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 316/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:32 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:33.562214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:33.562901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:33.569024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:33.569543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:33.570044 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:33.570816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:33.571262 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:33.571679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:33.584658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa HTTP/1.1 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:28:33.586803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:28:33.588326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '52bf4bcb-fcb0-4571-ab62-a01a701e27aa'} Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:28:33.589380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:28:33.590928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:33.592317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:28:33.592317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-89e9c9fd-877d-4c60-a65e-0068f671544d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 404 len: 111 microversion: 2.1 time: 0.030687 Sep 28 12:28:33.592317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 320/636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:33 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:28:33.597020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6cdc2066-e78c-49e9-8886-7b5b70cbbed9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '.version_select at 0x7fa706c7ad30>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:33.617390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6cdc2066-e78c-49e9-8886-7b5b70cbbed9 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916556233" status: 202 len: 0 microversion: 2.1 time: 0.024207 Sep 28 12:28:33.617967 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 317/637] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 12:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916556233 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:28:34.298130 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:34.298611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:34.304424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:34.304904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:34.305369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:34.306167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:34.306614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:34.307029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:34.429408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lazy-loading 'services' on Instance uuid 58f4d7a5-a42f-4ce7-bf29-b689265cceba {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:28:34.549472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-529dc5cd-01eb-4b09-ba4d-0fc06c623b8e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments/bd95400b-9bae-4237-bd5e-a83f9f444b9d" status: 202 len: 0 microversion: 2.1 time: 0.254866 Sep 28 12:28:34.550167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 321/638] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:28:34 2022] DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments/bd95400b-9bae-4237-bd5e-a83f9f444b9d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:28:34.558915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:34.561306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:34.568096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:34.568585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:34.569048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:34.569754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:34.570350 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:34.570688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:34.602596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1071ebcc-7c2e-4abf-800c-a1f47b3ee44d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 Sep 28 12:28:34.603954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 318/639] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:28:34 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:35.617575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:35.619978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:35.626114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:35.626596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:35.627026 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:35.627717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:35.628168 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:35.628592 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:35.657659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b6c7d58c-c1bc-46c3-9eff-28f11d6a260e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Sep 28 12:28:35.658309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 322/640] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:28:35 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:36.670574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:36.672806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:36.679773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.680301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.680731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:36.681449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.681904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.682325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:36.710920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-03a75e90-a331-4bd0-a0e2-f9faef652eee tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044124 Sep 28 12:28:36.711467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 319/641] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:28:36 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:28:36.774409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:36.774909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:36.781291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.781761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.782185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:36.782886 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.783329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.783742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:36.809296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:28:36.882244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b2de18ff-681d-45e5-9687-f88417bf361a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 204 len: 0 microversion: 2.1 time: 0.111543 Sep 28 12:28:36.883509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 323/642] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:28:36 2022] DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:28:36.891606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:36.892212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:36.898096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.898652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.899005 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:36.899689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:36.900139 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:36.900563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:37.026190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:37.033829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3b3a0d58-2c4b-493c-ac09-42ababfeafce tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1680 microversion: 2.1 time: 0.146153 Sep 28 12:28:37.034391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 320/643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:36 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:38.058426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:38.059139 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:38.065370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:38.065845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:38.066280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:38.066957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:38.067400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:38.067811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:38.203842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:38.212004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c26638ee-9b56-4b33-aa50-229b23bd8f41 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1680 microversion: 2.1 time: 0.158205 Sep 28 12:28:38.212606 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 324/644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:38 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:39.236087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:39.236691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:39.243336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:39.243814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:39.244247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:39.244936 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:39.245422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:39.245845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:39.381522 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:39.389909 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6e2d6ec8-cfb9-4779-8656-b7a2642dc61b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1680 microversion: 2.1 time: 0.157623 Sep 28 12:28:39.390477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 321/645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:39 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:40.068029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4d7a5-a42f-4ce7-bf29-b689265cceba", "name": "network-vif-deleted", "tag": "7db57789-d5c3-4711-9222-79c5c2dd7daa"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:40.078992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:40.079562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:40.080080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:40.091623 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] Creating event network-vif-deleted:7db57789-d5c3-4711-9222-79c5c2dd7daa for instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba on hv-cinder-84456 Sep 28 12:28:40.096807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-6bbd64e2-266b-47a7-9eea-5f6d6e509b93 req-d4a0d285-281c-4ad9-ba65-4795137643f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Sep 28 12:28:40.097509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 325/646] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:40.413348 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:40.414094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:40.421025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:40.421581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:40.422067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:40.423033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:40.423494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:40.423923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:40.457839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:40.458330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:40.458769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:40.459219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lazy-loading 'fault' on Instance uuid 58f4d7a5-a42f-4ce7-bf29-b689265cceba {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:28:40.500000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:40.508238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d0ea79e5-a7e7-475b-94a9-773fbd12fab8 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 200 len: 1331 microversion: 2.1 time: 0.098797 Sep 28 12:28:40.508800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 322/647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:40 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:41.276734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:41.277307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:41.283327 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.283805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.284232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.284915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.285395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.285810 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.308719 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lazy-loading 'flavor' on Instance uuid 2f5ac8a6-16a1-4459-be8d-26474655e1e1 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:28:41.378498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-349fc6f2-e5aa-4010-9b5b-6b6e059c7abd tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "POST /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1/action" status: 202 len: 0 microversion: 2.1 time: 0.107007 Sep 28 12:28:41.379271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 326/648] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:28:41 2022] POST /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:28:41.388340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:41.389068 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:41.395604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.396109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.396569 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.397488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.398822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.399438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.528723 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:41.531708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:41.532938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:41.536870 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e08bcb35-f503-4a25-a6fe-1d344d3b27d2 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.152453 Sep 28 12:28:41.537545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 323/649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:41 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:41.543342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.543834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.545144 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.545849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:41.546298 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:41.546721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:41.562247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba HTTP/1.1 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:28:41.563885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:28:41.565417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '58f4d7a5-a42f-4ce7-bf29-b689265cceba'} Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:28:41.566393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:28:41.567861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:28:41.569226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:28:41.569226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b8572857-dd68-474d-a175-9279b7ee658d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 404 len: 111 microversion: 2.1 time: 0.037858 Sep 28 12:28:41.569226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 327/650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:41 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:28:41.574606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b2affc1e-fd46-4aaa-9669-63f21f32a7c0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '.version_select at 0x7fa706c25ca0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:41.593597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b2affc1e-fd46-4aaa-9669-63f21f32a7c0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773603324" status: 202 len: 0 microversion: 2.1 time: 0.022689 Sep 28 12:28:41.594158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 324/651] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 12:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773603324 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:28:42.210755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c13e271d-0f47-444e-a771-5f26cb0c2e12 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: .version_select at 0x7fa706c2dc10>, body: {"keypair": {"name": "tempest-keypair-1177564177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh7Udh9tqWJ9+b6SyCitVVHAnsyltEnVSuiVrtD/iyv0DxUxwsB7WHIaolLg9mJalkh+zLmOjGCkFshdG/UMGvNi7nATt1MmEu47GyOO59GFt4wLAzFgo267OwhEE4qMg=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:42.226919 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-c13e271d-0f47-444e-a771-5f26cb0c2e12 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:28:42.230740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-c13e271d-0f47-444e-a771-5f26cb0c2e12 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:28:42.257092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c13e271d-0f47-444e-a771-5f26cb0c2e12 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050306 Sep 28 12:28:42.257837 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 328/652] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:28:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:42.560588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:42.561298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:42.567116 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:42.567597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:42.568032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:42.568713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:42.569180 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:42.569604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:42.704897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:42.713262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-31fa223a-75ba-48dd-8dba-a0942165f258 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.157030 Sep 28 12:28:42.713827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 325/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:42 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:43.435051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-659188206", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75ba08fd-c198-48e0-8c9c-8b6efb7d5c44"}], "security_groups": [{"name": "tempest-securitygroup--583618871"}], "key_name": "tempest-keypair-1177564177", "user_data": "}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:43.536056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] validate_networks() for [('75ba08fd-c198-48e0-8c9c-8b6efb7d5c44', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:28:43.737857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:43.738466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:43.745697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:43.746191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:43.746639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:43.747324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:43.747794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:43.748194 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:43.886806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:43.895162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9d5ea7f6-36ff-4fe0-b074-749bf234fa27 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.161108 Sep 28 12:28:43.895658 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 326/654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:43 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:43.941816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:28:43.942238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:28:43.942744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:28:43.943152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:28:43.943559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:28:43.952275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:43.952757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:43.953227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:43.953950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:43.954409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:43.954833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:43.971176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:28:43.975070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:28:43.986345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:28:43.988588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:28:44.037616 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-937cb637-9458-41d6-b145-cb4cec80b6a3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607112 Sep 28 12:28:44.038968 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 329/655] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:28:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:28:44.050073 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a1491860-ac63-4b6b-a6d1-dd36f53c9b5d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:44.050680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a1491860-ac63-4b6b-a6d1-dd36f53c9b5d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:44.103292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a1491860-ac63-4b6b-a6d1-dd36f53c9b5d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:44.110061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a1491860-ac63-4b6b-a6d1-dd36f53c9b5d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1241 microversion: 2.1 time: 0.063866 Sep 28 12:28:44.110620 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 327/656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:44 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:44.918952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:44.919562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:44.926679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:44.927166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:44.927595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:44.928283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:44.928734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:44.929795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:45.060424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:45.068047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ea63afef-f920-46c9-8fd4-6854e90b0575 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.153664 Sep 28 12:28:45.068600 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 330/657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:44 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:45.131561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:45.132785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:45.139722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:45.140205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:45.140642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:45.141356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:45.141809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:45.142232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:45.202689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:45.210317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85c43e23-df89-4854-899a-be682ec7571c tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1293 microversion: 2.1 time: 0.082489 Sep 28 12:28:45.210875 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 328/658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:45 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:46.092397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:46.092994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:46.099923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:46.100411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:46.101790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:46.102506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:46.102960 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:46.103379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:46.107716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:46.234004 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:46.234646 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:46.241402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:46.242227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:46.242679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:46.243388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:46.243844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:46.244269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:46.307496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:46.315053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4f69f221-ab10-4f47-b33e-0086b5870430 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1299 microversion: 2.1 time: 0.084893 Sep 28 12:28:46.315620 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 329/659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:46 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:46.498151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:46.507824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9d965b63-b464-44a3-9b99-370e39e3939e tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.418546 Sep 28 12:28:46.508638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 331/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:46 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:47.226846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6bc4a06-8fe2-4961-986a-39cdd04d73b2", "tag": "9ed1e443-712c-429f-acbc-a99c94197210"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:47.237608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:47.239418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:47.240283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:47.254209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] Creating event network-changed:9ed1e443-712c-429f-acbc-a99c94197210 for instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 on hv-cinder-84456 Sep 28 12:28:47.260539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-8e82a38f-4082-490d-ad06-325d5c6836cf req-7e75603f-2202-4232-8086-da565b34c646 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Sep 28 12:28:47.261162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 330/661] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:47.339710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:47.340309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:47.346988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:47.347464 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:47.347978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:47.348658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:47.349108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:47.349556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:47.532469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:47.533232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:47.540178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:47.540662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:47.541103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:47.541826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:47.542285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:47.542734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:47.544092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:47.551866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ca768b64-abcf-43f5-9542-718b3643a7fa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.215890 Sep 28 12:28:47.552664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 332/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:47 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:47.677490 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:47.686192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-59ad9c09-8d68-4497-8ae9-db0ee0132161 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.157966 Sep 28 12:28:47.686764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 331/663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:47 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:48.575521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:48.576125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:48.582547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:48.583079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:48.583509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:48.584187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:48.584633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:48.585083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:48.709487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:48.710104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:48.712246 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:48.716438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:48.716904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:48.717384 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:48.718086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:48.718538 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:48.718955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:48.719700 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-333e9747-4d10-440c-bb5c-4654d816ae76 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.148014 Sep 28 12:28:48.720520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 333/664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:48 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:48.737107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:48.847211 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:48.854926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fe1ab56e-7788-4889-b68f-1686fcbc36d6 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.149272 Sep 28 12:28:48.855481 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 332/665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:48 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:49.742971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:49.743580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:49.750575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:49.751059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:49.751490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:49.752189 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:49.752642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:49.753066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:49.880090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:49.881107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:49.888822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:49.889343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:49.890499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:49.890499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:49.890965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:49.892189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:49.896980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:49.906835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3ba0138a-4469-4887-9d5a-98256d30e2ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.167531 Sep 28 12:28:49.907764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 334/666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:49 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:50.035027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:50.042944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-48551054-ccd5-49d1-b3c0-6523707f1bbe tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.167006 Sep 28 12:28:50.043510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 333/667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:49 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:50.934212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:50.934949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:50.948140 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:50.948636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:50.951825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:50.952645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:50.953146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:50.953641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:51.067179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:51.068442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:51.075561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:51.076381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:51.077089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:51.078036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:51.078726 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:51.079363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:51.197260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:51.205292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bff98fcf-4214-4d7e-ba1e-75c2feaa9899 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.276953 Sep 28 12:28:51.205944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 335/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:50 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:51.279965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:51.287653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a5d0901-3126-4103-9030-9bb3c6ae1ddf tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.224354 Sep 28 12:28:51.288398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 334/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:51 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:52.232323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:52.233658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:52.240965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:52.242196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:52.242932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:52.243733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:52.244101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:52.244585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:52.313036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:52.314259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:52.329507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:52.330009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:52.330599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:52.331472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:52.332090 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:52.332513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:52.446176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:52.458028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-04ffec8b-1524-485f-a3c9-4976c27b0825 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.233249 Sep 28 12:28:52.458721 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 336/670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:52 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:52.534222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bc4a06-8fe2-4961-986a-39cdd04d73b2", "name": "network-vif-plugged", "status": "completed", "tag": "9ed1e443-712c-429f-acbc-a99c94197210"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:52.545162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:52.545665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:52.546095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:52.557255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] Creating event network-vif-plugged:9ed1e443-712c-429f-acbc-a99c94197210 for instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 on hv-cinder-84456 Sep 28 12:28:52.562405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-cd5da8da-7246-404d-b784-ed9ea09c01dc req-a3c6cafd-728e-4479-8115-19e9b76068cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101389 Sep 28 12:28:52.563040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 337/671] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:52.591076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:52.599013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-da9b9a2b-ed08-44fe-8c53-126da68a2aab tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.290866 Sep 28 12:28:52.599582 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 335/672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:52 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:53.483150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:53.483841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:53.490542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:53.491053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:53.491588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:53.492278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:53.492734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:53.493188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:53.622617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:53.623362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:53.629775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:53.630356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:53.630865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:53.632142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:53.633058 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:53.633524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:53.635550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:53.643300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3c9dae52-58b7-4c9f-9d74-1e8c9e5010b0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.164422 Sep 28 12:28:53.643873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 338/673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:53 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:53.762254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:53.769922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-31e2e4c2-3eb3-4fb3-baa5-c0e3e0005e8b tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.151173 Sep 28 12:28:53.770484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 336/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:53 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:54.666657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:54.667263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:54.669196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:54.669989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=10 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:54.675824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:54.676302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:54.676763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:54.677478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:54.677936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:54.678359 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:54.794113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:54.794752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:54.796567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:54.802548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:54.803076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:54.803491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:54.804494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:54.804951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:54.805467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:54.805784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:54.813725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8837304a-f0d4-412e-bd2f-c12392505bb7 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.151449 Sep 28 12:28:54.814495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 339/675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:54 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:54.938093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:54.946300 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-de45ae04-ed1c-41f3-918d-b744f656485c tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.156081 Sep 28 12:28:54.946864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 337/676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:54 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:55.836710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:55.837267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:55.843637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:55.844124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:55.844554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:55.845521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:55.845970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:55.846384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:55.970560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:55.971171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:55.976691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:55.979428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:55.979924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:55.980366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:55.981080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:55.981571 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:55.981988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:55.985893 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-42f4a0a8-7334-47f1-86c2-123eebda7031 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1366 microversion: 2.1 time: 0.153046 Sep 28 12:28:55.986692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 340/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:55 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:56.121524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:56.129276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24ac9b27-5fe2-410b-9126-6703a2ea3bb7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.163261 Sep 28 12:28:56.129850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 338/678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:55 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:57.011169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:57.011704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:57.018005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.018488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.018916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.019596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.020043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.020558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.151050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:57.152061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:57.152680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:57.158825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6e7d4664-068f-4dbc-961d-f3578e29f401 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1557 microversion: 2.1 time: 0.152415 Sep 28 12:28:57.159018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.159397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 341/679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:57 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:57.159559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.159874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.160643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.161181 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.161606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.182238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:57.183108 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:57.189452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.189938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.190368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.191052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.191498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.191916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.281642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-12aa4672-6bdb-4a6b-87e9-88fa11f4727a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103858 Sep 28 12:28:57.282356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 342/680] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:28:57 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:57.312753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:57.320626 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f23eac30-db82-4374-bc2b-b3f142bdd405 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1508 microversion: 2.1 time: 0.172375 Sep 28 12:28:57.321247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 339/681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:57 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:57.343224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:57.344493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:57.351042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.351780 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.352840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.354373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.354827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.355493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.386306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120393) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 12:28:57.451681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1fc47d6c-e498-43cf-a626-c5acb3bd174d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "POST /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1/action" status: 202 len: 0 microversion: 2.1 time: 0.112268 Sep 28 12:28:57.452301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 343/682] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:28:57 2022] POST /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:28:57.460252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:57.460853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:57.467659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.468148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.468576 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.469293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:57.470174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:57.470686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:57.607914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:57.615810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7166cbcd-e1af-453c-a96f-126426ae27a7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1516 microversion: 2.1 time: 0.159378 Sep 28 12:28:57.616373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 340/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:57 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:28:58.287710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6bc4a06-8fe2-4961-986a-39cdd04d73b2", "tag": "9ed1e443-712c-429f-acbc-a99c94197210"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:58.295082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:58.301981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:58.302710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:58.303137 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:58.316147 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] Creating event network-changed:9ed1e443-712c-429f-acbc-a99c94197210 for instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 on hv-cinder-84456 Sep 28 12:28:58.322334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-d77be242-abcf-4b55-a375-b771e6ba7131 req-e39173de-fcdf-488c-aef9-ac290ba0e2de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041206 Sep 28 12:28:58.323179 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 344/684] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:28:58.530338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "name": "network-vif-unplugged", "status": "completed", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:28:58.542439 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:58.543213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:58.543824 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:58.557976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.compute.server_external_events [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] Unable to find a host for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1. Dropping event network-vif-unplugged {{(pid=120392) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 12:28:58.558877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-e26839ea-771f-462a-b39d-87a7ec45526e req-08599b47-e981-4fda-a402-66031330307a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032340 Sep 28 12:28:58.559476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 341/685] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 12:28:58.640263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:58.641160 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:58.648310 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:58.649142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:58.649944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:58.650881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:58.651451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:58.652101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:58.793180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:28:58.801413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-824d0970-3347-4abc-a87d-c310edbdff4d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1518 microversion: 2.1 time: 0.166240 Sep 28 12:28:58.802231 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 345/686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:58 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:28:59.727794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:59.728381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:59.730243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:59.735564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.736050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.736483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.737188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.737642 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.738061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.769223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-07450de1-0066-4bb0-ae1f-9b3fd48f4ff2 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments/33d05429-fb68-49cb-937a-98d9dbd1a528" status: 200 len: 194 microversion: 2.20 time: 0.145148 Sep 28 12:28:59.769788 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 342/687] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Sep 28 12:28:59 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments/33d05429-fb68-49cb-937a-98d9dbd1a528 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:28:59.826068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:59.826797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:59.833283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.834140 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.834708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.837847 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.838421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.838953 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.839617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:28:59.840105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:28:59.847239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.847836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.848515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.849396 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:28:59.849844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:28:59.850267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:28:59.982213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lazy-loading 'services' on Instance uuid 3ae6ec0b-f117-438a-8147-6b661b54accd {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:29:00.000218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:00.008148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5dbb5474-8fd6-4214-a93f-27e35011da12 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.185965 Sep 28 12:29:00.008756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 346/688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:28:59 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:00.098904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bf7f7482-87b2-4309-9967-6a4f7488d1fc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments/33d05429-fb68-49cb-937a-98d9dbd1a528" status: 202 len: 0 microversion: 2.20 time: 0.263762 Sep 28 12:29:00.099922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 343/689] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 28 12:28:59 2022] DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments/33d05429-fb68-49cb-937a-98d9dbd1a528 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:29:00.108802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:00.111399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:00.117418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:00.118470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:00.118900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:00.119828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:00.120288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:00.120714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:00.151617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0c35f197-9345-44c8-8989-8b07e4b150e4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046773 Sep 28 12:29:00.152185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 347/690] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 12:29:00 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:29:01.033505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:01.034192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:01.040658 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:01.041255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:01.041684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:01.042369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:01.042818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:01.043230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:01.171194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:01.174460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:01.188360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:01.189369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:01.190156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:01.190877 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:01.191336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:01.191761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:01.197155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:01.207041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-520b574f-de4a-4010-882f-2ff85437eb53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.178234 Sep 28 12:29:01.213515 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:01.223466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 344/691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:01 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:01.229554 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-73406c4d-ca97-4019-bce0-bcb9d82c9ad5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069318 Sep 28 12:29:01.235150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 348/692] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 12:29:01 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:29:02.238972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:02.239991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:02.242578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:02.244945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:02.248029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.248776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.248975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.249828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.250291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.250710 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.252374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.252854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.253371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.254063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.254834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.255029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.284570 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-20c51931-2063-42c6-af29-67374bd667ab tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045765 Sep 28 12:29:02.285124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 349/693] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 12:29:02 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:02.348258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:02.348835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:02.355450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.356013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.356518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.357320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.357778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.358203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.382886 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:29:02.389721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:02.397360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fe79dcd9-e2ba-4d1f-abb7-c45f9d5c9391 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.162980 Sep 28 12:29:02.397931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 345/694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:02 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:02.458073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-917a2aa6-fece-4350-8850-bc329cde32c8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 204 len: 0 microversion: 2.20 time: 0.113561 Sep 28 12:29:02.458755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 350/695] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 12:29:02 2022] DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 12:29:02.467495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:02.468095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:02.474205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.474682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.475116 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.475793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:02.476239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:02.476657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:02.606137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:02.614055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:02.615493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:02.616637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8c099d0b-094a-4fef-bef2-eb28cdeb01e8 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.152972 Sep 28 12:29:02.617203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 346/696] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:02 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:03.421781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:03.422401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:03.428706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:03.429210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:03.429642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:03.430981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:03.431436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:03.431856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:03.562783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:03.570500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6d042127-01f2-4a52-b8e5-a3e0f6772fe7 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.153101 Sep 28 12:29:03.571073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 351/697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:03 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:03.642354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:03.642955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:03.649927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:03.650405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:03.650834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:03.651517 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:03.651966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:03.652385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:03.776645 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:03.784625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:03.786077 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:03.787209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2d81a3f2-d9f2-4607-8302-7b29fea65090 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.148675 Sep 28 12:29:03.787789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 347/698] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:03 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:04.593661 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:04.594270 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:04.600792 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:04.601309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:04.601743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:04.602933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:04.603380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:04.603801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:04.731291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:04.738954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-51928406-744d-48d0-b44b-6ccf49fb2e8a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.149104 Sep 28 12:29:04.739518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 352/699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:04 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:04.812755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:04.813388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:04.819715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:04.820192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:04.820625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:04.821675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:04.822144 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:04.822575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:05.011455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:05.019621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:05.021080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:05.022255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2c1f2eeb-91e9-4eb5-9817-535b2fd37af0 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1723 microversion: 2.20 time: 0.213402 Sep 28 12:29:05.022814 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 348/700] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:04 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:05.413320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6ec0b-f117-438a-8147-6b661b54accd", "name": "network-vif-deleted", "tag": "9fce75aa-da2d-404c-8c7f-84862f035240"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:05.430822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:05.431673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:05.432109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:05.444571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] Creating event network-vif-deleted:9fce75aa-da2d-404c-8c7f-84862f035240 for instance 3ae6ec0b-f117-438a-8147-6b661b54accd on hv-cinder-84456 Sep 28 12:29:05.456691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-42f745ad-a313-41b1-987c-6c16b5dc2b2d req-081aa323-6a58-4aec-b01d-f8abbee9ddbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106172 Sep 28 12:29:05.457914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 353/701] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:05.763471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:05.764075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:05.770190 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:05.770672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:05.771099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:05.771785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:05.772232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:05.772644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:05.777541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:05.906428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:05.914247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bd19a9ad-3fc4-4ca1-b211-1ebe37f1c0e0 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.154695 Sep 28 12:29:05.915031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 349/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:05 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:06.048285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:06.048974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:06.056695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:06.057423 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:06.057853 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:06.058545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:06.058996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:06.059409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:06.091713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:06.092442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:06.093025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:06.093677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lazy-loading 'fault' on Instance uuid 3ae6ec0b-f117-438a-8147-6b661b54accd {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:29:06.143939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:06.151682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:06.153145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:06.154467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-cfe56aaf-6577-41c6-a408-a48465747f4c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 200 len: 1369 microversion: 2.20 time: 0.110411 Sep 28 12:29:06.155027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 354/703] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:06 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:06.939460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:06.940046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:06.946555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:06.947033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:06.947461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:06.948143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:06.948589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:06.949008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:07.075853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:07.083379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6e4cfb6b-8a27-4454-9629-56d5c1a18c14 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.147808 Sep 28 12:29:07.083931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 350/704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:06 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:07.181957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:07.182572 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:07.188944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:07.189520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:07.189907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:07.190605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:07.191066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:07.191491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:07.205041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd HTTP/1.1 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:29:07.206733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:29:07.208420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '3ae6ec0b-f117-438a-8147-6b661b54accd'} Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:29:07.209530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:29:07.210980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:07.212889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:29:07.212889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ea6aa79d-9572-41e8-a790-ce6243ab4764 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 404 len: 111 microversion: 2.20 time: 0.030982 Sep 28 12:29:07.212889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 355/705] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:07 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:29:07.217840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99c9637a-9416-4ab4-af39-187617aae822 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '.version_select at 0x7fa706b83d30>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:07.236362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99c9637a-9416-4ab4-af39-187617aae822 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23839771" status: 204 len: 0 microversion: 2.20 time: 0.022297 Sep 28 12:29:07.236914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 351/706] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 28 12:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23839771 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:29:07.862299 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fb2bae70-5e40-42c6-8290-63fc76d2e87f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: .version_select at 0x7fa706b15ca0>, body: {"keypair": {"name": "tempest-keypair-774442442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK6ursZf8j5hOZhv/dcaMKSpaFOumDaUT8N5IprlBxNIOg7MTmwxVieIdX7cgDJ2eBadWT1kWnQo13rgRLZQ3h2VDdt2GOEpJbCrai2qrXG9/b8uRSmwTshCcwcCx7n1w=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:07.877446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-fb2bae70-5e40-42c6-8290-63fc76d2e87f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for project a396283cd8314a74bfd5e411c246cc96. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:29:07.881191 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-fb2bae70-5e40-42c6-8290-63fc76d2e87f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for user 4d7b7c68a699443aa5c0859094c265ec and project a396283cd8314a74bfd5e411c246cc96. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:29:07.903706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fb2bae70-5e40-42c6-8290-63fc76d2e87f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045243 Sep 28 12:29:07.904329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 356/707] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 28 12:29:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 12:29:08.106987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:08.107677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:08.113869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:08.114450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:08.114942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:08.115693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:08.116221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:08.116689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:08.266072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:08.274046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a2088135-784b-4c2b-bb81-d50449fa9ed5 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.171344 Sep 28 12:29:08.274674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 352/708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:08 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:09.299924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:09.300544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:09.308740 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:09.309257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:09.309685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:09.310384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:09.310834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:09.311255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:09.369302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1391244724", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d52528a4-371a-43c0-ba14-e43c1c223b47"}], "security_groups": [{"name": "tempest-securitygroup--119031197"}], "key_name": "tempest-keypair-774442442", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:09.450864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:09.458704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a739ccf1-9866-4dcb-948a-d0663fd07c29 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.164161 Sep 28 12:29:09.459281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 357/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:09 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:09.477202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] validate_networks() for [('d52528a4-371a-43c0-ba14-e43c1c223b47', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:29:09.888118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:29:09.888542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:29:09.889039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:29:09.889467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:29:09.889874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:29:09.898505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:09.899421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:09.899855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:09.900583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:09.901032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:09.901485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:09.918558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for project a396283cd8314a74bfd5e411c246cc96. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:29:09.922405 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Getting quotas for user 4d7b7c68a699443aa5c0859094c265ec and project a396283cd8314a74bfd5e411c246cc96. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:29:09.934240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:29:09.936519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:29:09.981778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d2420550-fe5a-4f16-9b0c-a56a515fb624 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.616873 Sep 28 12:29:09.982419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 353/710] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 28 12:29:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 28 12:29:09.994151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:09.994859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:10.047827 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:10.055974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:10.057626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:10.058722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8d899f30-985e-4f92-9ad1-58f792559bd5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1281 microversion: 2.20 time: 0.069139 Sep 28 12:29:10.059275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 358/711] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:09 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:10.483770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:10.485000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:10.491733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:10.492216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:10.493444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:10.494147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:10.494762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:10.495193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:10.634053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:10.641830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6b02b64d-4754-4f22-9b47-1074ee136b11 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.162624 Sep 28 12:29:10.642325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 354/712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:10 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:11.083243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:11.083879 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:11.091782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:11.092265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:11.092697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:11.093417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:11.093871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:11.094288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:11.153639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:11.162495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:11.164242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:11.169267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e150c7d2-5e28-49ee-a4d1-3c59fa0e5367 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1333 microversion: 2.20 time: 0.086881 Sep 28 12:29:11.169267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 359/713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:11 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:11.665973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:11.666603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:11.673106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:11.673549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:11.673976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:11.674654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:11.675100 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:11.675511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:11.848590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:11.856638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24024049-5a60-4346-8ec9-48641115af79 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.194735 Sep 28 12:29:11.857228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 355/714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:11 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:12.192011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:12.192785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:12.202291 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.202859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.203305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:12.204013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.205735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.205735 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:12.385337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:12.394042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:12.395616 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:12.396848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3ae56c35-0c2d-4d2f-8fd9-b8856d5d398d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.209734 Sep 28 12:29:12.397791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 360/715] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:12 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:12.524323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "name": "network-vif-plugged", "status": "completed", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:12.537203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.537824 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.538609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:12.551126 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] Creating event network-vif-plugged:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:29:12.558785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b7b0a0e1-bed2-4556-8a18-234a8c8a7c9f req-65aa5c2f-450d-47c8-a1fe-8b2f74a1fb69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Sep 28 12:29:12.559600 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 356/716] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:12.881733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:12.882526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:12.890241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.890905 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.891456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:12.892381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.892871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.893402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:12.972301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:12.985927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:12.986740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:12.987350 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:13.002497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] Creating event network-changed:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:29:13.007770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-62e13743-ede0-493c-b6c9-df691a98b853 req-23600f60-7ca6-40bd-8e38-36015ad8d45e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040855 Sep 28 12:29:13.009157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 357/717] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:29:13.292315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:13.300184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6d7a1575-4e78-4528-82ae-abf868518936 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.423664 Sep 28 12:29:13.300756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 361/718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:12 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:13.422387 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:13.423111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:13.429120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:13.429695 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:13.430652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:13.431307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:13.431782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:13.432201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:13.562137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:13.570001 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:13.572314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:13.573429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a973f07a-c21d-4523-b4de-7f7b838517f6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.155208 Sep 28 12:29:13.573970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 358/719] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:13 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:14.324119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:14.324749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:14.331182 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:14.331687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:14.332106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:14.332795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:14.333281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:14.333706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:14.464849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:14.472847 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-05422b89-d25c-4da2-9e59-1e1244fef20a tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1574 microversion: 2.1 time: 0.152786 Sep 28 12:29:14.473439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 362/720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:14 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:14.598299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:14.598828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:14.605438 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:14.605918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:14.606355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:14.607053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:14.607508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:14.607931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:14.733488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:14.741413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:14.743535 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:14.744609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-79886680-8c2d-4cc7-b6e5-f79dca5a17b5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.150609 Sep 28 12:29:14.745179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 359/721] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:14 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:15.495638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:15.496249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:15.502772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:15.503257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:15.503694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:15.504385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:15.504840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:15.505294 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:15.637581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:15.645246 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8fa51ad1-7967-421f-841f-fc53e50dce85 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1561 microversion: 2.1 time: 0.153455 Sep 28 12:29:15.645822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 363/722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:15 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:15.769455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:15.770059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:15.777238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:15.777727 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:15.778149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:15.778829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:15.779276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:15.779694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:15.907769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:15.915780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:15.917245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:15.918332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-39a69935-9505-4caa-86af-a04a784249ef tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.152720 Sep 28 12:29:15.918877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 360/723] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:15 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:16.231824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-157806550"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:16.232348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:16.238292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:16.238785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:16.239218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:16.239895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:16.240348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:16.240763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:16.376717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.network.security_group_api [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Removing security group a0f26316-ff48-45b5-8a12-373ee9ed20e6 from port f219904c-e6fd-43ca-be72-0b2ebac9da8f Sep 28 12:29:16.678340 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4a4190b2-c417-4a13-85f5-cf9e872e1bb2 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action" status: 202 len: 0 microversion: 2.1 time: 0.450337 Sep 28 12:29:16.682345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 364/724] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:29:16 2022] POST /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:29:16.687637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:16.697450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:16.697926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:16.698351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:16.711779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] Creating event network-changed:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:29:16.716851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b59aa324-6c0c-46a2-8cdb-7148ea7f07a7 req-5fae6af9-c059-4949-8b1a-0e5560375873 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032826 Sep 28 12:29:16.717776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 361/725] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:16.944441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:16.945950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:16.953039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:16.954067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:16.954983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:16.955803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:16.956332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:16.956984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:17.163083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:17.172676 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:17.173776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:17.174981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6ffc33c2-360b-42be-8ddb-3ad413288ef5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.235583 Sep 28 12:29:17.175540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 365/726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:16 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:17.748714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:17.749374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:17.755929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:17.756407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:17.756858 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:17.757550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:17.758049 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:17.758703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:17.838873 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lazy-loading 'services' on Instance uuid 25003613-64a5-4e59-9e42-7759c6d78994 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:29:17.910186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f2bb2cc4-cccf-4294-bd22-85bbfd5d41f4 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments/d13344bc-7599-4c98-8f03-9caba4e66d44" status: 202 len: 0 microversion: 2.1 time: 0.165644 Sep 28 12:29:17.910774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 362/727] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:29:17 2022] DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments/d13344bc-7599-4c98-8f03-9caba4e66d44 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:29:17.919729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:17.922350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:17.929428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:17.929428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:17.930252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:17.930988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:17.931442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:17.931868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:17.956743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:17.963075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ad4e10a1-84db-420e-9824-2c735d7f6900 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047397 Sep 28 12:29:17.963823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 366/728] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:29:17 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:18.200502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:18.201231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:18.207935 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:18.208423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:18.208862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:18.209601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:18.210059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:18.210484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:18.346767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:18.355632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:18.357067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:18.358217 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-219b8296-12b0-4c82-8c18-05b1217f1c9f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.162018 Sep 28 12:29:18.358931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 363/729] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:18 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:18.734090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:18.745872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:18.746560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:18.747666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:18.760581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] Creating event network-changed:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:29:18.765866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-f31f898b-2063-4366-9f0f-70ef73e91015 req-60c86f03-ae4a-4f64-be92-6874dd2fd009 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Sep 28 12:29:18.766801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 367/730] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:18.975944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:18.978759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:18.985846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:18.986322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:18.986888 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:18.987615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:18.988036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:18.988588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:19.020912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a32a0a62-7cc7-4563-bd9f-5f23f71b0d52 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Sep 28 12:29:19.021518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 364/731] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:29:18 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:19.383062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:19.383768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:19.390357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:19.390833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:19.391258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:19.391971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:19.392437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:19.392844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:19.597470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:19.606548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:19.608004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:19.609109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fbd28569-2d2b-4387-ae05-d7c036db6424 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.230339 Sep 28 12:29:19.609696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 368/732] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:19 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:20.033558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:20.035690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:20.037641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.038395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.045236 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.045723 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.046162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.046855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.047307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.047732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.076542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3168cda4-74ea-4b12-a9e2-f5d6e526257b tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046984 Sep 28 12:29:20.077092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 365/733] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:29:20 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:29:20.088358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:20.088849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:20.090782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.096406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.096887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.097364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.098052 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.098534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.098953 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.173480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] HTTP exception thrown: Instance 25003613-64a5-4e59-9e42-7759c6d78994 is not attached to volume d13344bc-7599-4c98-8f03-9caba4e66d44 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Request method failure captured: Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments/d13344bc-7599-4c98-8f03-9caba4e66d44 HTTP/1.1 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDz-ns9oTN5nTmLiU0j6p6McLJBdOLpoqgM2nFtQBDK73nc1s6zxMrt8iXTNTP57c7NuUByyP8Exa6W18zFTuKFYeA1_uSCx6xTyHYzw74mpre2fEFpWNBk8Kmw9imQjeuQtpN1ORUd21zAATBhrxygrSqFj2sbu-DX-dVs9rsLIqGQ Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 19f9f5faf55a4b0cb17bf36d8cb838f6 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:29:20.175835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_19f9f5faf55a4b0cb17bf36d8cb838f6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}] Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 19f9f5faf55a4b0cb17bf36d8cb838f6 Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-TestMinimumBasicScenario-1614611936-project Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 2ab18214df00412bb7440535ac725056 Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-TestMinimumBasicScenario-1614611936-project Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:29:20.177407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 25003613-64a5-4e59-9e42-7759c6d78994 is not attached to volume d13344bc-7599-4c98-8f03-9caba4e66d44 Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'server_id': '25003613-64a5-4e59-9e42-7759c6d78994', 'id': 'd13344bc-7599-4c98-8f03-9caba4e66d44'} Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d13344bc-7599-4c98-8f03-9caba4e66d44. Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:29:20.178280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25003613-64a5-4e59-9e42-7759c6d78994 is not attached to volume d13344bc-7599-4c98-8f03-9caba4e66d44 Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25003613-64a5-4e59-9e42-7759c6d78994 is not attached to volume d13344bc-7599-4c98-8f03-9caba4e66d44 Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:20.179598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Returning 404 to user: Instance 25003613-64a5-4e59-9e42-7759c6d78994 is not attached to volume d13344bc-7599-4c98-8f03-9caba4e66d44 {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:29:20.180639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a1ddad6e-4247-48ef-a8a8-798fd83dba76 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments/d13344bc-7599-4c98-8f03-9caba4e66d44" status: 404 len: 154 microversion: 2.1 time: 0.093487 Sep 28 12:29:20.180639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 369/734] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:29:20 2022] DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994/os-volume_attachments/d13344bc-7599-4c98-8f03-9caba4e66d44 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:29:20.634288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:20.634916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:20.640754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.641252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.641678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.642351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:20.642795 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:20.643208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:20.774787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:20.782755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:20.784182 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:20.785293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38e5e957-4771-4396-acf2-52a2aaa89771 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.155509 Sep 28 12:29:20.785835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 366/735] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:20 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:21.318906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:21.319406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:21.326297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.326806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.327231 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.327925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.328383 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.328814 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.354977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:29:21.428520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-91374828-453b-4792-b2d7-bccc29f8662a tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 204 len: 0 microversion: 2.1 time: 0.113179 Sep 28 12:29:21.429424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 370/736] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:29:21 2022] DELETE /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:29:21.437530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:21.438131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:21.444468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.444943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.445399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.446568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.447015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.447426 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.574088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:21.581710 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f74dee81-a8e9-45df-9906-9295fa89390f tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1555 microversion: 2.1 time: 0.147976 Sep 28 12:29:21.582267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 367/737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:21 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:21.811598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:21.812207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:21.818196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.818677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.819110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.819795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.820247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.820679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.915969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e78ba62-fe8d-4258-baf9-4ae7cfa9f014"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:21.918500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:21.924523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.925009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.925532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.926258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:21.926707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:21.927124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:21.949821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:21.957929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:21.959367 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:21.960466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2e08fc77-0996-463f-af48-a21c78691fad tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.153266 Sep 28 12:29:21.961018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 371/738] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:21 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:21.997794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:22.529324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "name": "network-vif-plugged", "status": "completed", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:22.540698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:22.541261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:22.541990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:22.553307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] Creating event network-vif-plugged:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:29:22.558645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-c85a8abc-39bd-45f9-abe8-61296337a228 req-27d1e93e-a6e4-46e3-a523-837b2603990d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Sep 28 12:29:22.559228 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 372/739] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:29:22.605265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:22.605963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:22.612031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:22.612508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:22.612942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:22.613663 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:22.614119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:22.614541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:22.743141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:22.750989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-efa05584-1ae9-43ff-965c-bb7839e15077 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1555 microversion: 2.1 time: 0.150105 Sep 28 12:29:22.751557 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 373/740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:22 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:22.986314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:22.986913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:22.992869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:22.993384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:22.993835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:22.994522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:22.994965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:22.995382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:23.118288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:23.126764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:23.128188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:23.129296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e9a87eb1-0a0c-4174-bb57-c20060eb0cd3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.147238 Sep 28 12:29:23.129859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 374/741] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:22 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:29:23.487495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c2c79588-7906-4e41-a682-99f008a26f25 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.576277 Sep 28 12:29:23.488435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 368/742] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:29:21 2022] POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments => generated 194 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:23.773084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:23.773769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:23.780612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:23.781089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:23.781546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:23.782232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:23.782675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:23.783090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:23.907153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:23.915000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-49eed3d3-4481-403b-9b88-8c713b3b6c93 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1555 microversion: 2.1 time: 0.145784 Sep 28 12:29:23.915594 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 375/743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:23 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:24.154468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:24.155101 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:24.161634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:24.162107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:24.162542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:24.163236 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:24.163684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:24.164105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:24.301379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:24.310629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:24.312141 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:24.313298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3aabb168-2208-45f0-ace0-767b6f523acd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.163362 Sep 28 12:29:24.313865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 369/744] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:24 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:29:24.946952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:24.948204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:24.955545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:24.956070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:24.956514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:24.957252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:24.957710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:24.958135 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:25.339163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:25.339734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:25.346664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:25.347143 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:25.347580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:25.348281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:25.348731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:25.349169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:25.439923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:25.460699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-43be0d58-d527-4439-9263-c6e26e0203e0 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1555 microversion: 2.1 time: 0.516341 Sep 28 12:29:25.464522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 376/745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:24 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1555 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:25.495942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:25.504881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:25.506701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:25.507908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ba18707e-0fca-4817-bf9b-014138205099 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1406 microversion: 2.20 time: 0.173638 Sep 28 12:29:25.508830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 370/746] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:25 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:29:25.753125 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25003613-64a5-4e59-9e42-7759c6d78994", "name": "network-vif-deleted", "tag": "f219904c-e6fd-43ca-be72-0b2ebac9da8f"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:25.763317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:25.763789 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:25.764212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:25.776941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] Creating event network-vif-deleted:f219904c-e6fd-43ca-be72-0b2ebac9da8f for instance 25003613-64a5-4e59-9e42-7759c6d78994 on hv-cinder-84456 Sep 28 12:29:25.782146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-966e04cb-413f-418c-ac3e-09761c69e092 req-35dd60d0-3844-495a-b714-2447018bd143 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034024 Sep 28 12:29:25.782718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 377/747] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:26.486333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:26.486944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:26.493513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.494002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.494441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.495196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.495852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.496284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.527310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.527803 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.528238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.528685 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lazy-loading 'fault' on Instance uuid 25003613-64a5-4e59-9e42-7759c6d78994 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:29:26.533956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:26.534646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:26.541187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.541673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.542810 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.543546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.544001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.544424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.569109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab18214df00412bb7440535ac725056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9f5faf55a4b0cb17bf36d8cb838f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:26.577746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7104733d-54f2-4bf3-9ad7-fc058de2039c tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 200 len: 1348 microversion: 2.1 time: 0.095142 Sep 28 12:29:26.578388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 371/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:26 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:26.672993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:26.681353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:26.682994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:26.684154 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7167546b-2772-4a4d-a718-4f8604a47c76 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1598 microversion: 2.20 time: 0.154382 Sep 28 12:29:26.684707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 378/749] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:29:26 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:29:26.708689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:26.709241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:26.716021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.716504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.716942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.717666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:26.718121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:26.718545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:26.799268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-36a980ad-7fd0-49e9-aa6f-2f6c9344a878 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094432 Sep 28 12:29:26.799861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 372/750] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 28 12:29:26 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:29:27.601459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:27.602185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] [instance: 25003613-64a5-4e59-9e42-7759c6d78994] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:27.609001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:27.609520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:27.616163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:27.616920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:27.617412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:27.617842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:27.632009 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] HTTP exception thrown: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Request method failure captured: Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 HTTP/1.1 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDz-ns9oTN5nTmLiU0j6p6McLJBdOLpoqgM2nFtQBDK73nc1s6zxMrt8iXTNTP57c7NuUByyP8Exa6W18zFTuKFYeA1_uSCx6xTyHYzw74mpre2fEFpWNBk8Kmw9imQjeuQtpN1ORUd21zAATBhrxygrSqFj2sbu-DX-dVs9rsLIqGQ Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 19f9f5faf55a4b0cb17bf36d8cb838f6 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:29:27.633701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_19f9f5faf55a4b0cb17bf36d8cb838f6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/19f9f5faf55a4b0cb17bf36d8cb838f6"}]}] Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 19f9f5faf55a4b0cb17bf36d8cb838f6 Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1614611936 Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-TestMinimumBasicScenario-1614611936-project Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 2ab18214df00412bb7440535ac725056 Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-TestMinimumBasicScenario-1614611936-project Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. Sep 28 12:29:27.635276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '25003613-64a5-4e59-9e42-7759c6d78994'} Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:29:27.636412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. Sep 28 12:29:27.637887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:29:27.638981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Returning 404 to user: Instance 25003613-64a5-4e59-9e42-7759c6d78994 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:29:27.638981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-eba4401c-8a2a-4268-bae2-30c00a113330 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994" status: 404 len: 111 microversion: 2.1 time: 0.037459 Sep 28 12:29:27.638981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 379/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:27 2022] GET /compute/v2.1/servers/25003613-64a5-4e59-9e42-7759c6d78994 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:29:27.644620 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1e3aa4b8-20ba-4048-bbb8-21341cdaa279 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] Calling method '.version_select at 0x7fa706b42550>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:27.664080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1e3aa4b8-20ba-4048-bbb8-21341cdaa279 tempest-TestMinimumBasicScenario-1614611936 tempest-TestMinimumBasicScenario-1614611936-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-209561139" status: 202 len: 0 microversion: 2.1 time: 0.023651 Sep 28 12:29:27.664650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 373/752] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 28 12:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-209561139 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:29:27.755107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:27.766672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:27.766672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:27.767058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:27.780137 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] Creating event network-changed:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:29:27.785830 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-0e60bb0f-940e-4d6a-89e3-86c60f96eb79 req-96b939a1-4e45-4e4c-8443-2de0afa5f07c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035171 Sep 28 12:29:27.786742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 380/753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:29:33.194486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:33.197682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:33.200477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.207801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.208506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.209069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.209789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.210238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.210655 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.234966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'flavor' on Instance uuid e73e939d-492c-4154-bd83-a2b02bc89043 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:29:33.374807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f17a273b-767b-4a86-a568-a41f26674e0a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/action" status: 200 len: 32 microversion: 2.1 time: 0.184937 Sep 28 12:29:33.375442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 374/754] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:29:33 2022] POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 12:29:33.386874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:33.388180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:33.393904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.396379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.397057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.397594 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.398330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.398786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.399208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.719177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:33.728589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f3cf77dc-f681-408f-b39e-1f4ffdc99e75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.346402 Sep 28 12:29:33.746594 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 381/755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:33 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:34.755850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:34.756961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:34.764900 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:34.765624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:34.766450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:34.767334 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:34.767944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:34.768524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:34.938922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:34.947718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fccd5a8d-f5ed-409f-abfc-3a71779576d0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.197248 Sep 28 12:29:34.965371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 375/756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:34 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:35.974118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:35.974720 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:35.981716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:35.982200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:35.982626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:35.983309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:35.983755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:35.984169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:36.129282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:36.137540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1f8fd42b-2758-4c9c-9340-d2824191acd4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.167195 Sep 28 12:29:36.138112 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 382/757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:35 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:37.162530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:37.163122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:37.170621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:37.171112 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:37.171552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:37.172249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:37.172706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:37.173154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:37.298929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:37.307008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e7b44ca-f862-45a4-87d1-02717631da9b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.148543 Sep 28 12:29:37.308149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 376/758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:37 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:38.331820 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:38.332428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:38.339305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:38.339790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:38.340231 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:38.340920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:38.341404 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:38.341831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:38.467161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:38.475976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-62a7026a-d427-42b7-8fc0-6fdda4b15460 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.148026 Sep 28 12:29:38.476540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 383/759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:38 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:39.499539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:39.500146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:39.506491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:39.506970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:39.507404 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:39.508087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:39.508539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:39.508961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:39.638783 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:39.646817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c1e10999-cefd-4464-87d5-c79df7ada4eb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.151155 Sep 28 12:29:39.647373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 377/760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:39 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:40.670936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:40.671543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:40.677884 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:40.678365 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:40.678797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:40.679481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:40.679935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:40.680356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:40.808850 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:40.816905 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-79fdc9c2-71ee-4ab9-9a94-f4cdcf387728 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.149827 Sep 28 12:29:40.817503 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 384/761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:40 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:41.841368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:41.841977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:41.848572 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:41.849086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:41.849553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:41.850246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:41.850700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:41.851123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:41.978639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:41.986614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5934f5df-dc47-4d72-85bf-3c2a5e643c58 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.149832 Sep 28 12:29:41.987170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 378/762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:41 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:43.009956 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:43.010552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:43.017793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:43.018284 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:43.018723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:43.019422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:43.019878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:43.020303 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:43.024609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:43.157264 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:43.165328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-82336943-604c-4ae7-810c-7d2ce98b35b5 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.159251 Sep 28 12:29:43.165896 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 385/763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:43 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:44.407689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:44.408294 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:44.414093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:44.414572 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:44.415276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:44.415960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:44.417074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:44.417550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:44.546491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:44.554682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-81352fd9-4a15-423d-9161-e870f4110c7f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.369373 Sep 28 12:29:44.555244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 379/764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:44 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:45.578474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:45.579085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:45.585545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:45.586034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:45.586472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:45.587161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:45.587617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:45.588223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:45.716339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:45.724662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7367fc99-8ad4-4010-b9db-c973c0c6bf1a tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.150126 Sep 28 12:29:45.725242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 386/765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:45 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:46.749582 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:46.750163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:46.756794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:46.757297 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:46.757728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:46.758401 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:46.758846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:46.759263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:46.883760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:46.892305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-04b4d575-8381-4851-bf32-e56242cf3bfd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.146611 Sep 28 12:29:46.892856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 380/766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:46 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:47.916206 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:47.917036 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:47.923279 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:47.923760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:47.924229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:47.924911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:47.927234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:47.927669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:48.057988 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:48.066101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-cfcac5f0-c8b3-48c3-b883-caebb09089c8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.154071 Sep 28 12:29:48.066680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 387/767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:47 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:49.090921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:49.091524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:49.098131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:49.098603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:49.099061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:49.099733 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:49.100179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:49.100597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:49.234220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:49.242674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-12d829e2-d895-454f-b990-23f848910374 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.156137 Sep 28 12:29:49.243258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 381/768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:49 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:50.266217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:50.266821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:50.272881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:50.273400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:50.273828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:50.274512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:50.274965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:50.275916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:50.473742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:50.482456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ba9306cb-0ef2-4af4-843c-aa04e0ae19bb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.220071 Sep 28 12:29:50.483024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 388/769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:50 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:51.506031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:51.506654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:51.513365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:51.513851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:51.514282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:51.514979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:51.515431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:51.515851 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:51.661314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:51.670491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-74e17c1d-4988-4f08-9eac-06408575aaf7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.168275 Sep 28 12:29:51.671071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 382/770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:51 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:52.695339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:52.695954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:52.702976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:52.703453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:52.703883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:52.704568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:52.705054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:52.705512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:52.832425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:52.840874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4f28f2a7-9206-4b01-8b8b-6fbf18ac1bbb tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.149260 Sep 28 12:29:52.841481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 389/771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:52 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:53.864439 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:53.864989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:53.871260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:53.871719 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:53.872147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:53.872830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:53.873316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:53.873741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:53.876361 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:54.001605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:54.010374 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b50c464e-86c1-4b3e-be67-b66853a7c903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1734 microversion: 2.1 time: 0.149171 Sep 28 12:29:54.010971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 383/772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:53 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:55.034903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:55.035514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:55.042623 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.043129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.043566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.044314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.044768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.045223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.440802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:55.449350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a0e306b4-c92b-4d97-a9b2-370c9a4397a0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1714 microversion: 2.1 time: 0.418310 Sep 28 12:29:55.449930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 390/773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:55 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1714 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:55.513352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:55.513889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:55.520200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.520683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.521118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.521823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.522275 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.522704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.602155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] HTTP exception thrown: Cannot 'detach_volume' instance e73e939d-492c-4154-bd83-a2b02bc89043 while it is in vm_state rescued Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Request method failure captured: Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments/2e78ba62-fe8d-4258-baf9-4ae7cfa9f014 HTTP/1.1 Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND0LhbExAQy4KLw-LCRTeclNrN0KrkDLKbxwK5o7vyXZnkbKeoXLXKdJ_4-jFrIP70ladAnu4H0KQPKqDrwR20CKR2j4oMyUZTL42O_9ScJ8OsFbyu5AD8Lx1hxe7w96_HMX6iyy61xDmghWVdIa5MtwFGMKeeyj-pkeVj0X37MVf-E Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:29:55.604419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1318535cbbd6427c8c770bd5b256ac3e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}] Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: cc96808ff3fb41f085f09aa943c3d016 Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:29:55.606134 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Cannot 'detach_volume' instance e73e939d-492c-4154-bd83-a2b02bc89043 while it is in vm_state rescued Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'server_id': 'e73e939d-492c-4154-bd83-a2b02bc89043', 'id': '2e78ba62-fe8d-4258-baf9-4ae7cfa9f014'} Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e73e939d-492c-4154-bd83-a2b02bc89043 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:29:55.606915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e73e939d-492c-4154-bd83-a2b02bc89043 while it is in vm_state rescued Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e73e939d-492c-4154-bd83-a2b02bc89043 while it is in vm_state rescued Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:29:55.608536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Returning 409 to user: Cannot 'detach_volume' instance e73e939d-492c-4154-bd83-a2b02bc89043 while it is in vm_state rescued {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:29:55.610003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5fad6114-15a4-47fe-b4b7-fc6149092ebd tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments/2e78ba62-fe8d-4258-baf9-4ae7cfa9f014" status: 409 len: 152 microversion: 2.1 time: 0.096788 Sep 28 12:29:55.610003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 384/774] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:29:55 2022] DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments/2e78ba62-fe8d-4258-baf9-4ae7cfa9f014 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 12:29:55.614794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:29:55.615323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:55.621216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.621697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.622124 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.622801 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.623249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.623665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.689306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2ddc8d7b-9e84-4eb2-9294-9bff2c5b868d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/action" status: 202 len: 0 microversion: 2.1 time: 0.077806 Sep 28 12:29:55.689973 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 391/775] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:29:55 2022] POST /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:29:55.698368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:55.698991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:55.704862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.705390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.705830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.706522 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.706987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.707548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.844721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:55.853154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2f59be66-c286-49ef-aeed-54fc123d35c4 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1722 microversion: 2.1 time: 0.158889 Sep 28 12:29:55.854273 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 385/776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:55 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:56.878232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:56.878921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:56.885485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:56.886009 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:56.886489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:56.887168 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:56.887618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:56.888035 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:57.013272 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:57.021400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5c13ca33-f046-4a71-8ea5-6ab89b249a0d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1722 microversion: 2.1 time: 0.147283 Sep 28 12:29:57.021963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 392/777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:56 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:58.046905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:58.047512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:58.053847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:58.054322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:58.054752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:58.055449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:58.055921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:58.056338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:58.181837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:58.190285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f963a6f2-76d4-428b-94f4-168331b1c7a8 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1722 microversion: 2.1 time: 0.148572 Sep 28 12:29:58.190839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 386/778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:58 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:59.214512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:59.215119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:59.221915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:59.222401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:59.222834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:59.223538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:59.223974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:59.224399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:59.355891 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:59.363931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-af45a2ed-c9aa-4fa5-bafd-331066c71270 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1722 microversion: 2.1 time: 0.153518 Sep 28 12:29:59.364494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 393/779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:59 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:00.388435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:00.389038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:00.394977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.395456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.395891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.396573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.397027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.397472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.526176 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:00.534765 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7dd556f4-c87a-420f-817d-eac1430281e7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1728 microversion: 2.1 time: 0.150785 Sep 28 12:30:00.535315 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 387/780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:00 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:00.558372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:00.558880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:00.565469 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.565974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.566404 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.567422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.567876 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.568295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.642566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7bb30b2f-a2ee-420e-86a1-ecae4452baef tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088571 Sep 28 12:30:00.643474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 394/781] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:30:00 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:01.530412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:01.543359 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:01.543835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:01.544262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:01.560860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] Creating event network-changed:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:30:01.569942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-ab670dbf-24e2-45bc-b99c-40a218f7883c req-6a0f4c21-04e7-4d19-8e4b-6c801973e007 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044200 Sep 28 12:30:01.570853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 388/782] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:03.585745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:03.590833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=28 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:03.596722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:03.597226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:03.597655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:03.609521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] Creating event network-changed:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:30:03.614581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-fcfd66e3-9580-4712-8b83-c8cc8fd60ad2 req-5cd4c7da-65b9-45bd-a3e6-3dafac1dff66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Sep 28 12:30:03.615202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 395/783] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:27.982492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=29 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:27.983229 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=31 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:27.988356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:27.988935 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:27.995918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:27.996414 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:27.996839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:27.997548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:27.997995 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:27.998416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:28.021889 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f42d8310-de9a-436f-ac96-b4e867ca32bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/ips" status: 200 len: 151 microversion: 2.1 time: 0.041976 Sep 28 12:30:28.022472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 389/784] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:30:27 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:29.375690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:29.376434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:29.382717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01c95415-c509-421f-bb7c-1434d8e374fa"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:29.385194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:29.393055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:29.393645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:29.394083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:29.394791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:29.395245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:29.395669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:29.676188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-79c215d2-28e5-4ace-b7e5-ea03c4164805 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302353 Sep 28 12:30:29.676945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 396/785] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:30:29 2022] POST /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:37.231163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01c95415-c509-421f-bb7c-1434d8e374fa"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:37.233584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:37.239391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.239864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.240290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.240982 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.241430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.241848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.319220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments HTTP/1.1 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 74 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:30:37.320898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {"volumeAttachment": {"volumeId": "01c95415-c509-421f-bb7c-1434d8e374fa"}} Sep 28 12:30:37.322592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'server_id': 'f6bc4a06-8fe2-4961-986a-39cdd04d73b2', 'body': {'volumeAttachment': {'volumeId': '01c95415-c509-421f-bb7c-1434d8e374fa'}}} Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:30:37.323943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:37.325475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 400 to user: Invalid volume: volume 01c95415-c509-421f-bb7c-1434d8e374fa is already attached to instances: f6bc4a06-8fe2-4961-986a-39cdd04d73b2 {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dc5ec462-05da-4bac-bfee-acbf0d0ece67 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095912 Sep 28 12:30:37.327197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 390/786] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:30:37 2022] POST /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:30:37.388253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:37.388828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:37.394950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.395427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.395859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.396535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.396990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.397442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.478679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lazy-loading 'services' on Instance uuid f6bc4a06-8fe2-4961-986a-39cdd04d73b2 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:30:37.552918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6cc9f79d-1004-4050-953f-6240af8e75ff tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments/01c95415-c509-421f-bb7c-1434d8e374fa" status: 202 len: 0 microversion: 2.1 time: 0.169260 Sep 28 12:30:37.553564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 397/787] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:30:37 2022] DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments/01c95415-c509-421f-bb7c-1434d8e374fa => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:30:37.562119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:37.564260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:37.570158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.570624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.571059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.571747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.572195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.572619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.603526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-66ce6f78-56b8-4abd-899f-91625e91184e tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Sep 28 12:30:37.604076 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 391/788] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:30:37 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:38.617025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:38.619387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:38.626121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.626599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.627032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.627722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.628177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.628602 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.656604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-61d06480-fb6c-4741-b057-d2736e7d7ea1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044435 Sep 28 12:30:38.657176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 398/789] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:30:38 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:30:38.720333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:38.720829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:38.727251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.727668 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.728104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.728792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.729274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.730208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.754866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:30:38.827936 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-29d79713-1752-4789-995d-a5140168aaac tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 204 len: 0 microversion: 2.1 time: 0.111403 Sep 28 12:30:38.828509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 392/790] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:30:38 2022] DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:30:38.838412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:38.839171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:38.845475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.845961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.846396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.847088 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.847541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.847961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.980882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:38.988617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-eb84d4f4-d55f-413c-adb5-86ce74bd6d03 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1682 microversion: 2.1 time: 0.154438 Sep 28 12:30:38.989195 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 399/791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:38 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:40.013989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:40.014704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:40.020870 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:40.021393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:40.021825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:40.022511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:40.022960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:40.023382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:40.151561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:40.159223 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77f9fe7f-dc8d-41ec-bb70-6232771709bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1682 microversion: 2.1 time: 0.150125 Sep 28 12:30:40.159784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 393/792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:40 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:41.182375 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:41.183027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:41.189628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:41.190110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:41.190537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:41.191224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:41.191670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:41.192087 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:41.449370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:41.457024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-293f8acf-52ce-4fb2-9e01-bcfe8bf77b62 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 200 len: 1682 microversion: 2.1 time: 0.278498 Sep 28 12:30:41.457641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 400/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:41 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:41.660509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bc4a06-8fe2-4961-986a-39cdd04d73b2", "name": "network-vif-deleted", "tag": "9ed1e443-712c-429f-acbc-a99c94197210"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:41.673162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:41.673948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:41.674376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:41.687202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] Creating event network-vif-deleted:9ed1e443-712c-429f-acbc-a99c94197210 for instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 on hv-cinder-84456 Sep 28 12:30:41.692942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-a55bddff-b79b-4782-8610-000eab8418fb req-5eb3c49e-1369-4192-bf95-ecf7a4ea5413 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036075 Sep 28 12:30:41.694146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 394/794] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:42.480994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:42.481629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:42.488536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:42.489022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:42.489484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:42.490176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:42.490659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:42.491077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:42.507591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 HTTP/1.1 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:30:42.509439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:30:42.511234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'f6bc4a06-8fe2-4961-986a-39cdd04d73b2'} Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:30:42.512118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:30:42.513624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:30:42.515262 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:30:42.515262 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4ba756ba-fa04-4eae-9a1f-24e0dab88df5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 404 len: 111 microversion: 2.1 time: 0.036002 Sep 28 12:30:42.515262 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 401/795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:42 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:30:42.523166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4feaf151-13e0-44c8-9abb-eae3db6b54bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '.version_select at 0x7fa706b260d0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:42.541485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4feaf151-13e0-44c8-9abb-eae3db6b54bf tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177564177" status: 202 len: 0 microversion: 2.1 time: 0.022301 Sep 28 12:30:42.542596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 395/796] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 12:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177564177 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:30:43.167473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b4ae89da-5182-4f07-8238-79990e4c8b16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: .version_select at 0x7fa706c5e940>, body: {"keypair": {"name": "tempest-keypair-473128238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWB3cUGHhvygt1/tS5lqq8lTmGWFZSedwMQJz0lhgk7NYP9B0umjTf1nIkj6wd5CYr/ODFutNSSPlFN6rlHxRbmbw+cv9H6wc96q8XLpzfnpCntqBztGvS4JVEdnNShuw=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:43.183147 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b4ae89da-5182-4f07-8238-79990e4c8b16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:30:43.186940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b4ae89da-5182-4f07-8238-79990e4c8b16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:30:43.208898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b4ae89da-5182-4f07-8238-79990e4c8b16 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045826 Sep 28 12:30:43.209539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 402/797] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:30:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:44.473054 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419065573", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75ba08fd-c198-48e0-8c9c-8b6efb7d5c44"}], "security_groups": [{"name": "tempest-securitygroup--1431482695"}], "key_name": "tempest-keypair-473128238", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:44.574951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] validate_networks() for [('75ba08fd-c198-48e0-8c9c-8b6efb7d5c44', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:30:44.939148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:30:44.939571 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:30:44.940071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:30:44.940506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:30:44.940916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:30:44.949974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:44.950451 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:44.950885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:44.951606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:44.952058 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:44.952479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:44.969437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:30:44.973309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Getting quotas for user 8429a502bca744fc9f5d5701fe9c766c and project 8f9ceb72510849c9a1cce4cde67d06d2. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:30:44.984607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:30:44.986981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:30:45.034254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cfec0f89-3973-4873-a921-3d527eba2e6b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566120 Sep 28 12:30:45.034821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 396/798] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:30:45.046915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c1b67591-9c2e-4f70-93e1-3ec4b7ede3ec tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:45.047505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c1b67591-9c2e-4f70-93e1-3ec4b7ede3ec tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:45.101806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c1b67591-9c2e-4f70-93e1-3ec4b7ede3ec tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:45.109508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c1b67591-9c2e-4f70-93e1-3ec4b7ede3ec tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1240 microversion: 2.1 time: 0.067420 Sep 28 12:30:45.110076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 403/799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:45 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:46.132369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:46.132881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:46.139461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:46.139947 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:46.140379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:46.141067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:46.141547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:46.141969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:46.203884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:46.211354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8133a041-68c3-41bf-bb28-5cebc53f4992 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1292 microversion: 2.1 time: 0.083358 Sep 28 12:30:46.211918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 397/800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:46 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:47.236639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:47.237402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:47.243778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:47.244285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:47.244733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:47.245940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:47.246407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:47.246858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:47.337287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:47.346050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d1687bd0-2a72-49cd-a8a8-7caef84175e0 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1298 microversion: 2.1 time: 0.113510 Sep 28 12:30:47.346552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 404/801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:47 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:30:48.194800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90eac6b-9262-46e2-bdbd-feb3d20bf4f5", "tag": "023f2828-3c6a-4c22-9ce8-9e10c629d988"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:48.205951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:48.206513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:48.207019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:48.218249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] Creating event network-changed:023f2828-3c6a-4c22-9ce8-9e10c629d988 for instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 on hv-cinder-84456 Sep 28 12:30:48.223378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-3a41c6e5-e6ab-4025-8069-d133aba44f61 req-0da852f2-04be-47a4-87ba-10be653f7d6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032194 Sep 28 12:30:48.223970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 398/802] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:48.368679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:48.369424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:48.376800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:48.377314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:48.377753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:48.378489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:48.378923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:48.379372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:48.583817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:48.591779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-818eea0a-bd97-407e-984f-d6502ba1dc34 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.226991 Sep 28 12:30:48.592444 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 405/803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:48 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:49.615846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:49.616588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:49.623197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:49.623667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:49.624121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:49.624796 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:49.625266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:49.625682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:49.753366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:49.761663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-55612d1e-be34-462e-b691-c1d8f24cf5ed tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.150503 Sep 28 12:30:49.762222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 399/804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:49 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:50.783798 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:50.784413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:50.790842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:50.791328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:50.791991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:50.792805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:50.793308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:50.793741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:50.925419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:50.933556 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fcf37b2e-55f0-40e2-a934-d7fb2c15fbfd tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.153602 Sep 28 12:30:50.934117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 406/805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:50 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:51.955734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:51.956334 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:51.963658 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:51.964173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:51.964607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:51.965391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:51.965844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:51.966267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:52.101267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:52.110092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7317b48e-97c6-4c0e-93cb-0d781caf6072 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.158082 Sep 28 12:30:52.110669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 400/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:51 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:53.133993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:53.137637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:53.142050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:53.142609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:53.143356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:53.143800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:53.144255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:53.144705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:53.277384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:53.285944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a4c0dd64-0441-4fbc-a078-1b03f37af7bb tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.155657 Sep 28 12:30:53.286523 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 407/807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:53 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:54.307973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:54.308578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:54.315001 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:54.315476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:54.315908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:54.316590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:54.317036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:54.317478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:54.442533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:54.450819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-977dde1e-d7ab-4299-a5bd-b1a4f9d12285 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.146633 Sep 28 12:30:54.451382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 401/808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:54 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:55.159067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90eac6b-9262-46e2-bdbd-feb3d20bf4f5", "name": "network-vif-plugged", "status": "completed", "tag": "023f2828-3c6a-4c22-9ce8-9e10c629d988"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:55.164688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:55.172342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:55.173691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:55.174119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:55.186715 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] Creating event network-vif-plugged:023f2828-3c6a-4c22-9ce8-9e10c629d988 for instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 on hv-cinder-84456 Sep 28 12:30:55.191716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-47fe6f5f-bc0e-47e5-a8cd-54fffb78a0fa req-23097828-2c20-4f43-b5f7-1549ed2f4d95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036377 Sep 28 12:30:55.192555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 408/809] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:55.475106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:55.475826 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:55.478017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:55.479327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:55.487209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:55.487687 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:55.488120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:55.488929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:55.489574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:55.489990 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:55.617447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:55.625247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c7e411a-96f1-41d6-a4ac-d9b99d14ef38 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.154304 Sep 28 12:30:55.625810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 402/810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:55 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:56.362976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:56.363553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:56.364641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:56.370434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.371013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.371444 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.372141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.372597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.373023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.375089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.375849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.376350 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.388447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] Creating event network-changed:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:30:56.394464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-10db5090-f205-4314-9f6a-11e74afc11d1 req-b8362f53-53bf-4988-9b0b-a57a0b64e45b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033495 Sep 28 12:30:56.395373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 403/811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:30:56.399637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:30:56.474856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f1fd65e7-1a53-49de-a36c-edb3e3c7699d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 204 len: 0 microversion: 2.1 time: 0.116223 Sep 28 12:30:56.475434 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 409/812] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:30:56 2022] DELETE /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:30:56.485684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:56.486498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:56.493598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.494082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.494521 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.495997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.496711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.497433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.643708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:56.648400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:56.649530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:56.652560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-edb3a452-aecf-4ed6-a22f-75e24644bca1 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.171027 Sep 28 12:30:56.653383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 404/813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:56 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:56.656287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.656797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.658442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.658442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:56.658442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:56.659019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.794260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:56.805761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6b7887db-c2ac-4958-b29a-a135ca3d879b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.161311 Sep 28 12:30:56.806509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 410/814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:56 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:57.372726 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:57.373253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:57.379268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.379807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.380166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.380850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.381324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.381740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.404549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cf0535ea-cb45-4ab5-9c45-102a386e6fce tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/ips" status: 200 len: 152 microversion: 2.20 time: 0.036596 Sep 28 12:30:57.405112 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 405/815] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 28 12:30:57 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:30:57.677531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:57.678224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:57.685763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.686249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.686685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.687382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.687840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.688263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.820396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:57.828209 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4641a8af-b2bf-432a-9108-65b48f735c53 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.154554 Sep 28 12:30:57.828771 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 411/816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:57 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:57.829761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:57.830364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:57.836592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.837065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.837587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.838275 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.839329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.839747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.967029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:57.974786 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5f2b4ab3-2806-48a3-a1fe-c66d0afbfb4d tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1366 microversion: 2.1 time: 0.148862 Sep 28 12:30:57.975345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 406/817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:57 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:30:58.851565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:58.852175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:58.859701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:58.860194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:58.860633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:58.861362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:58.861819 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:58.862245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:58.879989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:58.997589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:58.998638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:58.999244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.001867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:59.005407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-59c8c630-7c76-4088-967e-17e556e96568 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1567 microversion: 2.1 time: 0.157649 Sep 28 12:30:59.005977 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 412/818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:58 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:59.007905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.008382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.009024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.009747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.010365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.010973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.015668 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:59.218174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:59.226255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5e07ab0e-adbe-42a3-a37c-e9f07c9d1aa3 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1556 microversion: 2.1 time: 0.232226 Sep 28 12:30:59.226817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 407/819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:58 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:30:59.249068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:59.249684 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.259133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.260130 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.261025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.262513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.263406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.263955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.306812 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:59.307778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.315119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.315619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.316065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.316773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.317262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.317690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.342161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lazy-loading 'flavor' on Instance uuid 85f18682-4e17-44a1-8e5f-71e5179134b0 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:30:59.384915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-02ac6fd5-51c6-477d-a1f2-e2db020047b6 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139910 Sep 28 12:30:59.386275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 413/820] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:30:59 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:59.497050 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:59.497722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.499706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:59.507024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.507685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.508346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.509347 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.509913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.510512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.580369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-66d4b247-13f9-4c39-ae9b-a3ccda85ba0b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/action" status: 202 len: 0 microversion: 2.20 time: 0.280505 Sep 28 12:30:59.584899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 408/821] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 12:30:59 2022] POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:30:59.593118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:59.594504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.605467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.607157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.607805 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.608926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.609705 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.610512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.649503 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'services' on Instance uuid e73e939d-492c-4154-bd83-a2b02bc89043 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:30:59.747398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e40a298f-c072-49b5-ae2b-0fd1d7c6920f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments/2e78ba62-fe8d-4258-baf9-4ae7cfa9f014" status: 202 len: 0 microversion: 2.1 time: 0.254166 Sep 28 12:30:59.748197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 414/822] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:30:59 2022] DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments/2e78ba62-fe8d-4258-baf9-4ae7cfa9f014 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:30:59.757399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:59.759882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.767852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.768542 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.768777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.769610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.770249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.770749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.806431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-00431313-457c-45ae-951c-479f4dc350b0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053484 Sep 28 12:30:59.812019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 415/823] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:30:59 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:30:59.863820 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac8a6-16a1-4459-be8d-26474655e1e1", "name": "network-vif-deleted", "tag": "1711270f-ac5c-4882-9a07-75c09082815b"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:30:59.882371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.883162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.883775 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.890912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:59.899980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:59.900626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] Creating event network-vif-deleted:1711270f-ac5c-4882-9a07-75c09082815b for instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 on hv-cinder-84456 Sep 28 12:30:59.901445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:59.903445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9f741088-b0af-4ff2-9c73-f30a2acc0e0c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.315829 Sep 28 12:30:59.917325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 409/824] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:30:59 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:30:59.917634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-c6920795-c352-4fa3-801c-7eb52dd65206 req-9c5c1ff3-fe8a-4d8c-9957-c7941d84dd35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046595 Sep 28 12:30:59.917634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 416/825] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:00.029706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:00.030334 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:00.036227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.036781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.037326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.038081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.038607 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.039095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.123273 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:00.131120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7e154361-4124-49c6-a5d0-5d888577de5d tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1219 microversion: 2.1 time: 0.106039 Sep 28 12:31:00.131882 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 410/826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:00 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:00.820775 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:00.822959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:00.832667 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.833221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.834998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.835169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.836642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.837334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.893680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3a3e7f35-fa6a-4240-b7dd-21b0b24a5b1b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077506 Sep 28 12:31:00.894591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 417/827] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:31:00 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:00.923096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90eac6b-9262-46e2-bdbd-feb3d20bf4f5", "tag": "023f2828-3c6a-4c22-9ce8-9e10c629d988"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:00.935053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.936204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:00.936596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.936882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:00.937570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.950559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.951138 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.951610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.952319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.952785 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.953252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.955016 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] Creating event network-changed:023f2828-3c6a-4c22-9ce8-9e10c629d988 for instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 on hv-cinder-84456 Sep 28 12:31:00.960151 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-e349fb0f-dbe7-4fdc-bc4f-eb400b82b397 req-e060a658-b1ca-4c44-9bd7-2daa9e18784b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041650 Sep 28 12:31:00.961690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 411/828] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:01.154623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:01.156511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:01.163197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.164568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.165252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.173954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.175009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.175688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.191322 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:01.204562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:01.206882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:01.208318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9d24a743-cf48-4ad5-bf12-f99cc890ae2d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.276821 Sep 28 12:31:01.209682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 418/829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:00 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:01.240322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.240864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.241330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.241833 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lazy-loading 'fault' on Instance uuid 2f5ac8a6-16a1-4459-be8d-26474655e1e1 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:31:01.303290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49280c781ba745aa83bf4c5db9359973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f563e7675ef4d758e09e1a78b891c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:01.314175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-103ee7cb-216e-4bbb-aa93-3e1a100231cb tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 200 len: 1224 microversion: 2.1 time: 0.163342 Sep 28 12:31:01.316071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 412/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:01 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:01.908739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:01.911353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:01.919078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.919951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.920426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.921163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.921622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.922245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.956877 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-81d4eada-f902-453b-ba50-1c387fabaac7 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054084 Sep 28 12:31:01.957545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 419/831] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:31:01 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:31:02.042602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.043998 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:02.050856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.051606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.052446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.053161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.053630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.054240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.080963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:31:02.159817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b83274ea-9dbe-4b5c-9717-8319c5cdbb4f tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 204 len: 0 microversion: 2.1 time: 0.121019 Sep 28 12:31:02.160484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 413/832] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:31:02 2022] DELETE /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:31:02.169664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.170364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:02.176505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.176990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.177470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.178202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.178658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.179082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.236971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.237611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:02.243366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.243844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.244271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.244953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.245444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.245855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.309235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:02.316945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-79cc425b-421e-4769-8ed1-6e807a93b051 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1688 microversion: 2.1 time: 0.151864 Sep 28 12:31:02.317555 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 420/833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:02 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:02.340587 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.341315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] [instance: 2f5ac8a6-16a1-4459-be8d-26474655e1e1] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:02.347425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.347904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.348335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.349025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.349541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.349968 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.364007 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] HTTP exception thrown: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Request method failure captured: Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 HTTP/1.1 Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDzqdj5uxwXmzWQfhMg0m3h9lIVfA2fYHFPjGu1qDJnSyrtX2Pq1FrCbQlSje9e1oSHL7VUnDuMBs15K0QCe283yud1mteewubQ17eBIaXdXCOWVFXOtvycTEHlQANlpRbYmW_-KZANfaaYJcjQh56-nU95Hlp0NJ-N-lHRS9M0Q93k Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 1f563e7675ef4d758e09e1a78b891c9d Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-TestShelveInstance-253148251 Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:31:02.365672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f563e7675ef4d758e09e1a78b891c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f563e7675ef4d758e09e1a78b891c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f563e7675ef4d758e09e1a78b891c9d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f563e7675ef4d758e09e1a78b891c9d"}]}] Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-TestShelveInstance-253148251 Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 1f563e7675ef4d758e09e1a78b891c9d Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-TestShelveInstance-253148251 Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-TestShelveInstance-253148251-project Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 49280c781ba745aa83bf4c5db9359973 Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-TestShelveInstance-253148251-project Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. Sep 28 12:31:02.367116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '2f5ac8a6-16a1-4459-be8d-26474655e1e1'} Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:31:02.367922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. Sep 28 12:31:02.369204 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:02.370336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Returning 404 to user: Instance 2f5ac8a6-16a1-4459-be8d-26474655e1e1 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:31:02.370336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-398dab1d-e4a4-43fa-89a2-a54d6e2bb355 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1" status: 404 len: 111 microversion: 2.1 time: 0.030712 Sep 28 12:31:02.370336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 421/834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:02 2022] GET /compute/v2.1/servers/2f5ac8a6-16a1-4459-be8d-26474655e1e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:31:02.384406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:02.392898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:02.394456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:02.395797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dde2e62e-d5c6-450c-9632-e60d15fcfd1b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.163021 Sep 28 12:31:02.396269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 414/835] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:02 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:02.529948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b6d48fa5-d039-4e97-a542-8ac557b84406 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] Calling method '.version_select at 0x7fa706af2dc0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.549996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b6d48fa5-d039-4e97-a542-8ac557b84406 tempest-TestShelveInstance-253148251 tempest-TestShelveInstance-253148251-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-410200543" status: 202 len: 0 microversion: 2.1 time: 0.024454 Sep 28 12:31:02.550610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 422/836] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:31:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-410200543 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:31:03.340336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:03.340931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:03.347604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:03.348080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:03.348527 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:03.349604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:03.349736 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:03.350149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:03.423489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:03.424040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:03.431182 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:03.431681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:03.432235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:03.432935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:03.433418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:03.434504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:03.570302 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:03.575129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:03.579163 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-66f2aec1-73f1-4e40-834f-14e85f2b329b tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1688 microversion: 2.1 time: 0.242706 Sep 28 12:31:03.579739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 415/837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:03 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:03.587910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:03.587910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:03.587910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3950cd9d-f1bf-49d5-b4e7-75d7fd2f9c56 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.168959 Sep 28 12:31:03.588228 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 423/838] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:03 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:04.604680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:04.605432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:04.615550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:04.617218 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.617748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.618085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:04.618864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.619634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.620107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.620541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.629373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.630249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.630959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.631873 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.632530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.633213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.769150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:04.777078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6b1b64b5-2589-4e64-bb8b-82f97798abaf tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1688 microversion: 2.1 time: 0.177022 Sep 28 12:31:04.777970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 424/839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:04 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:04.880214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:04.888310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:04.889779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:04.890922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ee651a50-f191-488a-b27b-21026cbb5552 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.279771 Sep 28 12:31:04.891496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 416/840] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:04 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:05.803146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:05.803146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:05.811219 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.811714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.812150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:05.812863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.813579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.813945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:05.915996 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:05.916606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:05.924606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.925088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.925566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:05.926261 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.926710 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.927126 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:06.063612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:06.072283 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:06.073758 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:06.075260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-57fb24a5-198e-4c7c-a2b1-29f451e25aa1 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.163084 Sep 28 12:31:06.075819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 417/841] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:05 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:06.425757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:06.435730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6ffe4e10-f821-4a91-88e8-3b069bae4757 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1688 microversion: 2.1 time: 0.637610 Sep 28 12:31:06.436718 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 425/842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:05 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1688 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:07.101247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:07.101877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:07.109183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.109841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.110396 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.111091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.111541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.111961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.458888 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:07.459486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:07.467269 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.468047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.468967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.469760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.470432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.470918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.503593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:07.511545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:07.513378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:07.514518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-797379f1-bdc5-4dac-af70-c98d7499616f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.417193 Sep 28 12:31:07.515064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 418/843] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:07 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:07.560986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:07.568811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ac8e2b32-5b04-446b-af42-dee725ff77fa tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1621 microversion: 2.1 time: 0.114079 Sep 28 12:31:07.569412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 426/844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:07 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:07.771512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73e939d-492c-4154-bd83-a2b02bc89043", "name": "network-vif-deleted", "tag": "e395fd4a-81c3-4231-b156-f137389eb7db"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:07.782627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.783103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.783741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.801566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] Creating event network-vif-deleted:e395fd4a-81c3-4231-b156-f137389eb7db for instance e73e939d-492c-4154-bd83-a2b02bc89043 on hv-cinder-84456 Sep 28 12:31:07.809321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-3b8fe63a-d2df-477e-9f2a-09b8050acbbd req-b2e661c0-53cf-47de-b70d-e69cf2aca35e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040862 Sep 28 12:31:07.811152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 419/845] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:08.540040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:08.540885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:08.557733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.558222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.559338 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.560240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.560869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.561479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.596619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:08.597467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:08.604094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.604708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.605281 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.606842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.607388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.607963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.656659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.657376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.657969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.658601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'fault' on Instance uuid e73e939d-492c-4154-bd83-a2b02bc89043 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:31:08.760587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:08.763606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:08.774656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-68312ad3-8736-40a1-9c9a-dfdcb7ac3d75 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 200 len: 1335 microversion: 2.1 time: 0.186331 Sep 28 12:31:08.779075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 420/846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:08 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 1335 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:08.802223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:08.816846 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:08.818840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:08.822153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-374c3a19-c389-4bc5-ba53-a534d44938eb tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.285553 Sep 28 12:31:08.823407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 427/847] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:08 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:09.803221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:09.803886 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: e73e939d-492c-4154-bd83-a2b02bc89043] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:09.811988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:09.812806 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:09.813364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:09.814154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:09.814737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:09.815273 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:09.830219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] HTTP exception thrown: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Request method failure captured: Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 HTTP/1.1 Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND0LhbExAQy4KLw-LCRTeclNrN0KrkDLKbxwK5o7vyXZnkbKeoXLXKdJ_4-jFrIP70ladAnu4H0KQPKqDrwR20CKR2j4oMyUZTL42O_9ScJ8OsFbyu5AD8Lx1hxe7w96_HMX6iyy61xDmghWVdIa5MtwFGMKeeyj-pkeVj0X37MVf-E Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:31:09.831915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1318535cbbd6427c8c770bd5b256ac3e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}] Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: cc96808ff3fb41f085f09aa943c3d016 Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. Sep 28 12:31:09.833672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'e73e939d-492c-4154-bd83-a2b02bc89043'} Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:31:09.834585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. Sep 28 12:31:09.836022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:09.837330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Returning 404 to user: Instance e73e939d-492c-4154-bd83-a2b02bc89043 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:31:09.837330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a0255a6a-a38f-4291-9768-9f032ccee903 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043" status: 404 len: 111 microversion: 2.1 time: 0.034102 Sep 28 12:31:09.837330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 421/848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:09 2022] GET /compute/v2.1/servers/e73e939d-492c-4154-bd83-a2b02bc89043 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:31:09.842881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-16261907-3d18-4afd-8aad-ec7768a8dab0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '.version_select at 0x7fa706a94700>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:09.858883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:09.860959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:09.873125 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:09.873966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:09.874583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:09.875667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:09.876979 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:09.877628 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:09.878131 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-16261907-3d18-4afd-8aad-ec7768a8dab0 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783736508" status: 202 len: 0 microversion: 2.1 time: 0.039181 Sep 28 12:31:09.879054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 428/849] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 12:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783736508 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:31:10.154203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:10.163474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:10.165080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:10.167315 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8853fe04-c018-4f45-a473-6119d1a8af5f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.316250 Sep 28 12:31:10.169715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 422/850] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:09 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:11.197397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:11.198000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:11.205262 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:11.205755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:11.206193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:11.207113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:11.207802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:11.208177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:11.346107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:11.354380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:11.355855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:11.357014 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b71e3f03-74e4-4ad2-8f9a-51f72bbc37aa tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.164090 Sep 28 12:31:11.357784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 429/851] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:11 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:12.382966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:12.383563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:12.390441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.390912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.391340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:12.392016 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.392461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.392877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:12.524041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:12.532717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:12.534214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:12.535354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-83a9362e-0bf3-4839-8f53-53705fde01e3 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.156276 Sep 28 12:31:12.535901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 423/852] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:12 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:12.979379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:12.979870 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:12.986255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.986730 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.987159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:12.987837 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.988288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.988704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.016914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:31:13.049571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:13.092997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d7c4e631-0f31-417a-9aac-2448ada2be91 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 204 len: 0 microversion: 2.1 time: 0.117082 Sep 28 12:31:13.094184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 430/853] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:31:12 2022] DELETE /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:31:13.103916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:13.104862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:13.111738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.112288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.112727 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.113463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.113930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.114328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.247082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:13.254857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f8f8bf3d-9271-4140-b822-7ba22224fc9d tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1506 microversion: 2.1 time: 0.156085 Sep 28 12:31:13.255431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 424/854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:13 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:13.561662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:13.562382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:13.568235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.568687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.569170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.569868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.570323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.570727 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.698134 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:13.706795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:13.708220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:13.709391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8381cafd-4cae-41a1-9834-0f33915458ea tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.152943 Sep 28 12:31:13.709972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 431/855] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:13 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:14.279188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:14.279791 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:14.286307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.286780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.287210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:14.287891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.288338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.288755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:14.420398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:14.428173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-09b6bfcc-71f7-4d0f-a96a-7f087b9d4363 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1506 microversion: 2.1 time: 0.153528 Sep 28 12:31:14.428741 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 425/856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:14 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:14.734985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:14.735538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:14.741922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.742403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.742834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:14.743519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.743970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.744391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:14.868593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:14.877243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:14.878695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:14.879843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-90976c93-853e-4df2-bc0a-f248eff941db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.148843 Sep 28 12:31:14.880401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 432/857] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:14 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:15.220344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "name": "network-vif-plugged", "status": "completed", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:15.231651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:15.232680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:15.233115 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:15.244392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] Creating event network-vif-plugged:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:31:15.249510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-82918d24-726d-4205-89d1-2490ba1bf312 req-41fa31b8-603a-495c-9d99-ced4747bc621 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Sep 28 12:31:15.250279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 426/858] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:15.451484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:15.452099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:15.458025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:15.458512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:15.458952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:15.459645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:15.460106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:15.460531 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:15.635739 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:15.643783 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-22d519af-d806-45f8-a0b8-ffc63abc3b71 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1506 microversion: 2.1 time: 0.196433 Sep 28 12:31:15.644355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 433/859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:15 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:15.905605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:15.906299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:15.912898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:15.913407 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:15.913839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:15.914523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:15.914970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:15.915386 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.022774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef4ea58-06f0-4031-a8a0-16d8be1614cb", "name": "network-vif-deleted", "tag": "a78a4209-5195-4106-9e3b-df3a33a1b706"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:16.037449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.038313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.039038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.051832 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] Creating event network-vif-deleted:a78a4209-5195-4106-9e3b-df3a33a1b706 for instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb on hv-cinder-84456 Sep 28 12:31:16.057023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-c767afb6-1774-4915-99f6-7be437ecab4d req-cf22788f-63c0-4def-9e82-06905be23cdc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038125 Sep 28 12:31:16.061541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 434/860] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:31:16.066986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:16.077662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:16.079187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:16.080433 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cf1a76da-ba5b-4639-9a8d-bfbb9c1b82cc tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.179231 Sep 28 12:31:16.085219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 427/861] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:15 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:16.668223 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:16.668838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:16.675061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.675577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.676012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.676706 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.677186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.677614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.710282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.710766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.711210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.711653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'fault' on Instance uuid 6ef4ea58-06f0-4031-a8a0-16d8be1614cb {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:31:16.756862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:16.765083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-dc391e22-8226-42e1-af9a-f32fb3a60a36 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 200 len: 1311 microversion: 2.1 time: 0.101847 Sep 28 12:31:16.765669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 435/862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:16 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:17.112476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:17.113113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:17.119650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.120156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.120621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.121408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.121857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.122276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.252652 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:17.261250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:17.263533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:17.264683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b39251f0-cc71-4827-8eec-3b13a9d9a38c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1744 microversion: 2.20 time: 0.156174 Sep 28 12:31:17.265254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 428/863] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:17 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:17.787927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:17.788494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 6ef4ea58-06f0-4031-a8a0-16d8be1614cb] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:17.799488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.799488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.799488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.799488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.799985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.799985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.813627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] HTTP exception thrown: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Request method failure captured: Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb HTTP/1.1 Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND0LhbExAQy4KLw-LCRTeclNrN0KrkDLKbxwK5o7vyXZnkbKeoXLXKdJ_4-jFrIP70ladAnu4H0KQPKqDrwR20CKR2j4oMyUZTL42O_9ScJ8OsFbyu5AD8Lx1hxe7w96_HMX6iyy61xDmghWVdIa5MtwFGMKeeyj-pkeVj0X37MVf-E Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:31:17.815049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1318535cbbd6427c8c770bd5b256ac3e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}] Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: cc96808ff3fb41f085f09aa943c3d016 Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. Sep 28 12:31:17.816435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '6ef4ea58-06f0-4031-a8a0-16d8be1614cb'} Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:31:17.817607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. Sep 28 12:31:17.818854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:31:17.821153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Returning 404 to user: Instance 6ef4ea58-06f0-4031-a8a0-16d8be1614cb could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:31:17.821153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-be2f7687-8d34-4795-bc66-6d4c3c11685c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb" status: 404 len: 111 microversion: 2.1 time: 0.032538 Sep 28 12:31:17.821153 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 436/864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:17 2022] GET /compute/v2.1/servers/6ef4ea58-06f0-4031-a8a0-16d8be1614cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:31:17.825525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:17.826021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:17.835385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.835872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.836310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.837000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.837483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.837993 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.866562 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:31:17.959038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c253d665-d0e8-4856-8210-baa8b8715915 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 204 len: 0 microversion: 2.1 time: 0.136828 Sep 28 12:31:17.959688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 429/865] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:31:17 2022] DELETE /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:31:17.968773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:17.969762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:17.976469 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.977098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.977643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.978448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.978989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.979508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:18.278209 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:18.287868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5ec68ed4-ff2e-4ae4-b6fb-848b5de2c15c tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.323300 Sep 28 12:31:18.291327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:18.292032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:18.298692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:18.299411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:18.300207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:18.301064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:18.301684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:18.302248 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:18.304752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 437/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:17 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:18.442909 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:18.451864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:18.453322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:18.454475 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3b39a1b7-c6cb-41de-8b64-b19311b63f27 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.167627 Sep 28 12:31:18.455033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 430/867] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:18 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:19.311540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:19.312264 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:19.318543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.319271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.319794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.320560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.321110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.321630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.460808 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:19.469538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-50ba8bfa-45fa-4e15-ad4e-8900c4c17045 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.162066 Sep 28 12:31:19.470100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 438/868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:19 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:19.481880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:19.483034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:19.489365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.489840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.490268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.490983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.491429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.491848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.632268 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:19.643499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:19.645379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:19.646725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e529ee22-e348-4eac-bf8c-4cb09e3e8b81 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.169602 Sep 28 12:31:19.647355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 431/869] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:19 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:20.493442 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:20.494768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:20.501384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.501874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.502306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.503000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.503451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.503866 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.676609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:20.677402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:20.685439 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.686760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.687458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.688501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.689368 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.690036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.718024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:20.729598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-222f5da4-b4e7-4d0e-9fb5-39d7744af820 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1521 microversion: 2.1 time: 0.239807 Sep 28 12:31:20.745704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 439/870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:20 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:20.848107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:20.857483 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:20.858912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:20.860435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a18ec12e-a1c3-4e4e-bf87-bf16d7d6c8bd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.189085 Sep 28 12:31:20.861179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 432/871] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:20 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:21.177567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b649038-e0a8-45a6-a118-534dcc182549", "name": "network-vif-deleted", "tag": "09e1cefa-c541-48a1-923b-e5aa1c92ec8c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:21.195429 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.196056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.196857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.211882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] Creating event network-vif-deleted:09e1cefa-c541-48a1-923b-e5aa1c92ec8c for instance 2b649038-e0a8-45a6-a118-534dcc182549 on hv-cinder-84456 Sep 28 12:31:21.218800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-c09468c1-162a-49a5-8e7c-386dd43d2964 req-46328d4c-1741-4187-8e5b-962368d96674 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046295 Sep 28 12:31:21.220082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 440/872] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:21.755467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:21.756009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:21.766195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.767222 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.767824 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.768703 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.769346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.769771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.801810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.802519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.803116 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.803568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lazy-loading 'fault' on Instance uuid 2b649038-e0a8-45a6-a118-534dcc182549 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:31:21.852776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96808ff3fb41f085f09aa943c3d016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318535cbbd6427c8c770bd5b256ac3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:21.862201 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e1c6ced7-65ed-4f69-b140-416c7936d3d6 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 200 len: 1312 microversion: 2.1 time: 0.111429 Sep 28 12:31:21.862964 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 433/873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:21 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:21.887845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:21.888723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:21.895951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.896541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.897079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.897834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.898530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.899018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:22.054873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:22.064114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:22.065608 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:22.066958 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c1ac6b43-80a9-4e63-8141-e96ed0a7355b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.184609 Sep 28 12:31:22.068001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 441/874] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:21 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:22.888382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:22.889000 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] [instance: 2b649038-e0a8-45a6-a118-534dcc182549] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:22.895499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:22.896314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:22.897570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:22.898599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:22.899215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:22.899800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:22.914237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] HTTP exception thrown: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Request method failure captured: Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 HTTP/1.1 Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND0LhbExAQy4KLw-LCRTeclNrN0KrkDLKbxwK5o7vyXZnkbKeoXLXKdJ_4-jFrIP70ladAnu4H0KQPKqDrwR20CKR2j4oMyUZTL42O_9ScJ8OsFbyu5AD8Lx1hxe7w96_HMX6iyy61xDmghWVdIa5MtwFGMKeeyj-pkeVj0X37MVf-E Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:31:22.915890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1318535cbbd6427c8c770bd5b256ac3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1318535cbbd6427c8c770bd5b256ac3e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1318535cbbd6427c8c770bd5b256ac3e"}]}] Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 1318535cbbd6427c8c770bd5b256ac3e Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-837781547 Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: cc96808ff3fb41f085f09aa943c3d016 Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-837781547-project Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. Sep 28 12:31:22.918010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '2b649038-e0a8-45a6-a118-534dcc182549'} Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:31:22.919249 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. Sep 28 12:31:22.921610 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:31:22.923015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] Returning 404 to user: Instance 2b649038-e0a8-45a6-a118-534dcc182549 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:31:22.923015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45a406c6-9dc1-486e-afed-7cfb7c964e13 tempest-ServerRescueNegativeTestJSON-837781547 tempest-ServerRescueNegativeTestJSON-837781547-project] 10.222.0.60 "GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549" status: 404 len: 111 microversion: 2.1 time: 0.033387 Sep 28 12:31:22.923015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 434/875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:22 2022] GET /compute/v2.1/servers/2b649038-e0a8-45a6-a118-534dcc182549 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:31:23.106757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:23.108503 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:23.117762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:23.118460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:23.119081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:23.120019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:23.121467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:23.122134 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:23.285782 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:23.300171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:23.301688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:23.303079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b0065d7c-a3a4-40f4-9117-48fea9543034 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.211220 Sep 28 12:31:23.304273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 442/876] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:23 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:24.329286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:24.330495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:24.341152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:24.341829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:24.343019 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:24.344147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:24.344759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:24.345364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:24.778429 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:24.790029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:24.794258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:24.799830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-da76beb8-de34-4644-9608-04d84b493521 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.474407 Sep 28 12:31:24.813957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 435/877] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:24 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:25.829234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:25.830609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:25.837430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:25.838163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:25.838902 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:25.839711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:25.840355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:25.840813 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:26.168358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:26.178057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:26.181683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:26.183672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-8b67489c-cb81-4431-bb94-3ae12aa86924 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.357884 Sep 28 12:31:26.184762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 443/878] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:25 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:27.210515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:27.211125 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:27.218924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:27.219677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:27.220928 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:27.221742 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:27.222444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:27.223021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:27.410589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:27.419895 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:27.421787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:27.423285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-30f62d57-0bf5-468b-97d2-99e133b2195a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.216546 Sep 28 12:31:27.424136 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 436/879] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:27 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:28.456366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:28.457123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:28.465104 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:28.465962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:28.466635 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:28.467851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:28.468677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:28.469514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:28.936707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:28.945448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:28.947309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:28.948604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-672d17ec-c265-496b-9a8a-277646de349f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1739 microversion: 2.20 time: 0.496832 Sep 28 12:31:28.949329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 444/880] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:28 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1739 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:29.975043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:29.975636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:29.977794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:29.983765 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:29.984257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:29.984694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:29.985460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:29.985917 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:29.986338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:30.007933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:30.491208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:30.500832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:30.502947 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:30.504452 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7f4af953-aeea-4965-a969-376635c4591d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1721 microversion: 2.20 time: 0.533446 Sep 28 12:31:30.505542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 437/881] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:29 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1721 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:31.532343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:31.534177 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:31.540516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:31.542432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:31.543194 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:31.546614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:31.547550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:31.548202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:31.549418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:31.748923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:31.757453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:31.759170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:31.760390 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-475385de-8418-490d-b23f-2156c8ae285d tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1721 microversion: 2.20 time: 0.233157 Sep 28 12:31:31.761668 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 445/882] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:31 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:32.787467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:32.788755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:32.797360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:32.798251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:32.798734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:32.799707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:32.800316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:32.801284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:32.983343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:32.991537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:32.993173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:32.994581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f89412c6-cb36-49d4-8cac-524857c5b282 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1664 microversion: 2.20 time: 0.211726 Sep 28 12:31:32.995997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 438/883] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:32 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:33.021171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d67f500-94c3-4325-a0f7-530edfbdf7e2"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:33.023515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:33.029976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.030461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.030896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.031597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.032046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.032464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.049292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-90240d6b-923c-460a-8820-bd71508dfcc5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: .version_select at 0x7fa706bc0430>, body: {"keypair": {"name": "tempest-keypair-992874332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaaE+V0OYt+UrYiMcW/bbr0ko6x26HQSYp+UC/u7GPVBn54ttpJ6P9dzl3vNfTbOy+FoqEzf2ZDwJBL/+SX+wJ1y4enlSoNftTNyCxLTLVDGqW0LE9/6BOZu4tu0L7SwQ=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:33.065648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-90240d6b-923c-460a-8820-bd71508dfcc5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:31:33.069849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-90240d6b-923c-460a-8820-bd71508dfcc5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for user 1885a2c4c42b47cb892b097557575642 and project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:31:33.095738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-90240d6b-923c-460a-8820-bd71508dfcc5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211157 Sep 28 12:31:33.105024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 446/884] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:31:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:31:33.407134 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "name": "network-vif-unplugged", "status": "completed", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:33.422333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.423102 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.423698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.438208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.compute.server_external_events [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] Unable to find a host for instance 85f18682-4e17-44a1-8e5f-71e5179134b0. Dropping event network-vif-unplugged {{(pid=120393) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 12:31:33.439458 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-08b4ce83-6950-490b-b1b6-a7760cd004d1 req-6b0557ac-dbf3-4482-93fc-6ac9c6a420d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036345 Sep 28 12:31:33.440793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 447/885] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 12:31:33.484807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b71d449-6ec4-4389-8729-c9a9b37c064e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.467584 Sep 28 12:31:33.485729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 439/886] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 28 12:31:33 2022] POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments => generated 188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:31:33.655170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:33.655935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:33.662793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.663289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.663727 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.664614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.664874 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.665372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.780352 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:33.947184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c6788f5e-60f9-4dad-a24a-4ff347bba30b tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments/0d67f500-94c3-4325-a0f7-530edfbdf7e2" status: 202 len: 0 microversion: 2.20 time: 0.296737 Sep 28 12:31:33.947909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 448/887] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 28 12:31:33 2022] DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments/0d67f500-94c3-4325-a0f7-530edfbdf7e2 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:31:34.016253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:34.018662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:34.027366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.028574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.029317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.030809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.032478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.033416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.111965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120392) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 12:31:34.201051 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2b73d995-bb53-436c-82e9-dc55bc5c2d3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/action" status: 202 len: 0 microversion: 2.20 time: 0.190348 Sep 28 12:31:34.202026 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 440/888] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 12:31:34 2022] POST /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:31:34.210436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:34.212520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:34.220299 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.221174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.221932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.222659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.223141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.223540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.419093 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:34.427659 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:34.429102 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:34.430319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-055e69a5-eafb-4ecc-aec2-49ab9a3c7376 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1672 microversion: 2.20 time: 0.224338 Sep 28 12:31:34.430878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 449/889] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:34 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:34.678594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1311283509", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39f4ee97-5c8b-4b12-ab00-ecff529a7cc2"}], "security_groups": [{"name": "tempest-securitygroup--1420825099"}], "key_name": "tempest-keypair-992874332", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:34.813154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] validate_networks() for [('39f4ee97-5c8b-4b12-ab00-ecff529a7cc2', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:31:35.240535 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:31:35.241260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:31:35.241830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:31:35.242248 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:31:35.242648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:31:35.254226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.254704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.255127 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.256015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.256774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.257391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.275682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:31:35.279839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for user 1885a2c4c42b47cb892b097557575642 and project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:31:35.290750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:31:35.293476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:31:35.345277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-707e9a71-25da-4ecf-bad5-361f82e4105a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672008 Sep 28 12:31:35.346022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 441/890] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:31:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:31:35.358094 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-98ef79b0-708d-4736-bb69-f346ee6fd1fd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:35.358831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-98ef79b0-708d-4736-bb69-f346ee6fd1fd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:35.421409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-98ef79b0-708d-4736-bb69-f346ee6fd1fd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:35.428680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-98ef79b0-708d-4736-bb69-f346ee6fd1fd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1237 microversion: 2.1 time: 0.074852 Sep 28 12:31:35.429345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 450/891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:35 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:35.459675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:35.463442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:35.471173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.471762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.472393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.473098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.473674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.474103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.627706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:35.638940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:35.640395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:35.641583 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d0bf9e0-f0a3-4da0-b291-c73663f84941 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.186885 Sep 28 12:31:35.642129 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 442/892] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:35 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:36.455683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:36.456406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:36.465308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:36.465880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:36.466630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:36.467661 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:36.468647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:36.469301 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:36.539000 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:36.548351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3817f167-7627-404c-852a-a94c88cda115 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1289 microversion: 2.1 time: 0.098572 Sep 28 12:31:36.561166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 451/893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:36 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:36.669849 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:36.672706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:36.684507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:36.684992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:36.685872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:36.688023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:36.688460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:36.688920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:36.888816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:36.897550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:36.899041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:36.900204 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9a54fbb3-f39e-4642-90bb-11c04ccaf4db tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.236780 Sep 28 12:31:36.900756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 443/894] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:36 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:37.578621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:37.579899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:37.589837 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.591319 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.591925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:37.592821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.594800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.595563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:37.806099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:37.815158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-14e1ae54-a43a-4f03-a9f2-9d2fb91ad45c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.243886 Sep 28 12:31:37.830247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 452/895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:37 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:37.927364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:37.928011 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:37.936045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.936533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.936973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:37.937708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.938167 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.938633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:38.078901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:38.087256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:38.088748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:38.089945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-da17b89e-aa4a-4712-8f18-995cba351459 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.166512 Sep 28 12:31:38.090682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 444/896] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:37 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:38.839992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:38.840654 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:38.847504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:38.847995 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:38.848430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:38.849141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:38.849611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:38.850033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:38.999967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:39.007994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ba103589-d4d7-4d9c-a139-6ab1c7f4a5bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.172658 Sep 28 12:31:39.008560 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 453/897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:38 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:39.116564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:39.117413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:39.125313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:39.125801 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:39.126234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:39.126933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:39.127382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:39.127810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:39.270500 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:39.278993 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:39.280444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:39.281665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1f4efa06-bf32-429c-86b7-cf64de4365ec tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.169567 Sep 28 12:31:39.282215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 445/898] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:39 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:40.032869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:40.033541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:40.040254 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.040804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.041330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.042439 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.043145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.043581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.190652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:40.199422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f2c9ebaa-6595-4322-8bb9-9d645c8d5970 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.170587 Sep 28 12:31:40.201242 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 454/899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:40 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:40.308618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:40.309343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:40.315732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.316426 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.317059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.317972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.318591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.319177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.463352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:40.472329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:40.473807 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:40.474941 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d365b833-3864-4778-a407-a9e332ed6b7e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.171029 Sep 28 12:31:40.475487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 446/900] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:40 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:41.224086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:41.224703 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:41.231728 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.232471 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.233067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.233806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.234257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.234679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.375385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:41.384567 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-18a86b7a-9e7c-4722-9006-9ce919648c62 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.164192 Sep 28 12:31:41.385166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 455/901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:41 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:41.502591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:41.503265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:41.509689 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.510162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.511516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.512307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.512757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.513199 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.652494 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:41.660918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:41.662417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:41.663580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d3db2f4c-5276-45dd-bc6d-86225828adb7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.165139 Sep 28 12:31:41.671842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 447/902] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:41 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:42.407940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:42.409869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:42.416321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.417382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.418087 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:42.418947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.419809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.420247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:42.561215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:42.568957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2a422f08-f277-4434-9622-265037583f4c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.164713 Sep 28 12:31:42.569453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 456/903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:42 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:42.690856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:42.691522 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:42.699202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.699681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.700327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:42.701023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.701498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.701915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:42.847181 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:42.856861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:42.858324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:42.859473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-26b7edbe-f909-4863-b13c-d3fbdcd65977 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.172701 Sep 28 12:31:42.860218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 448/904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:42 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:43.592513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:43.594184 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:43.602067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:43.602637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:43.603156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:43.603916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:43.605037 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:43.605552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:43.736126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:43.745086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-890f1c45-9a15-4a3b-98e1-cac106908905 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.156829 Sep 28 12:31:43.745717 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 457/905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:43 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:43.886347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:43.886948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:43.893504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:43.894028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:43.894417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:43.895111 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:43.895604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:43.896026 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:44.042109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:44.050674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:44.052142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:44.053331 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d15e59ad-537d-4c61-925c-a83f25d94679 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.171374 Sep 28 12:31:44.053878 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 449/906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:43 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:44.768066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:44.769421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:44.776975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:44.777510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:44.777947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:44.778653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:44.779110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:44.779534 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:44.911993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:44.920489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d1a3fed7-bf30-4d34-b18f-1764a745e80a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.156408 Sep 28 12:31:44.921058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 458/907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:44 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:45.079024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:45.080285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:45.086985 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.087611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.088050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:45.089608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.090246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.090675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:45.225945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:45.235738 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:45.237678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:45.239174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7a854b66-749f-4c67-af17-d6efa10585b6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.164378 Sep 28 12:31:45.247209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 450/908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:45 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:45.940058 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:45.945536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:45.946145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:45.953448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.953936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.954370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:45.955066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.955521 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.955942 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:46.084932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:46.092488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2cc5657f-aff2-440a-ade8-1695904f5ad5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.153233 Sep 28 12:31:46.093062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 459/909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:45 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:46.264533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:46.265046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:46.266869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:46.267520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:46.274022 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:46.274501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:46.274927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:46.275613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:46.276059 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:46.276573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:46.279187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:46.411219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:46.419922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:46.421410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:46.422561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e3e25a19-d447-44c3-8495-23219f1b0981 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.161987 Sep 28 12:31:46.423120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 451/910] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:46 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:47.115780 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:47.116324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:47.123424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.123903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.124333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.125025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.125497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.125918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.251152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:47.258579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b29bb881-1dc5-4171-9db2-c8a40a1d92c2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.146717 Sep 28 12:31:47.259136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 460/911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:47 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:47.447956 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:47.448830 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:47.455462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.455946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.456380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.457065 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.457551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.457980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.586237 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:47.595307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:47.596737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:47.597901 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b74a1e37-8424-414b-b79c-10ff4a8373e6 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.154099 Sep 28 12:31:47.598446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 452/912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:47 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:48.281600 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:48.282210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:48.288596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.289085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.289552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.290245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.290704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.291132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.419187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:48.426825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-05e6bbeb-9a06-4fe3-ae2c-8eef9d1d0c45 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.149085 Sep 28 12:31:48.427384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 461/913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:48 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:48.623487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:48.624089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:48.630459 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.630934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.631364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.632041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.632487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.632906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.758234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:48.766700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:48.768142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:48.769326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f3efb236-634c-4cad-ae84-13f420adfcc5 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.150314 Sep 28 12:31:48.769869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 453/914] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:48 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:49.452330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:49.452992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:49.459372 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:49.459860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:49.460298 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:49.460993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:49.461495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:49.461927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:49.664586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:49.672452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b957c376-2b2e-4d97-9009-bd9c9cefe821 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.225514 Sep 28 12:31:49.672978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 462/915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:49 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:49.796532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:49.797124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:49.803863 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:49.804352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:49.804794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:49.805534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:49.805989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:49.806412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:49.947945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:49.956356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:49.957939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:49.959178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-51406d36-c105-4c4a-bf8c-a4bfb15f9cfd tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.167653 Sep 28 12:31:49.959820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 454/916] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:49 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:50.243414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54de1c40-5bbc-4c85-a7e2-339655ec6716", "tag": "429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:50.252712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.253208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.253639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.263978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] Creating event network-changed:429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0 for instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 on hv-cinder-84456 Sep 28 12:31:50.269056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-98a3d32c-75ec-4bee-ae51-3a85e8057181 req-32463e07-4179-480f-915f-b10f42793d93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029321 Sep 28 12:31:50.269709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 463/917] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:50.695970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:50.696574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:50.703075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.703558 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.703996 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.704686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.705154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.705588 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.831595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:50.839845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dee22c38-669d-4720-b670-1ecf3e3924db tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.147721 Sep 28 12:31:50.840358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 455/918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:50 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:50.985675 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:50.986816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:50.993933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.994994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.995693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.996840 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.997710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.997815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:51.130424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:51.139432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:51.140886 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:51.142072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a7c90618-d2ec-40dd-803a-8a0ada16b026 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.161119 Sep 28 12:31:51.142628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 464/919] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:50 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:31:51.863808 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:51.864564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:51.871413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:51.871891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:51.872580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:51.873454 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:51.873908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:51.874484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:52.009415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:52.017636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b82e364-17f8-4e88-bea9-ddf011dc2c64 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.157979 Sep 28 12:31:52.018196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 456/920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:51 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:52.167272 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:52.168363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:52.175222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:52.175711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:52.176148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:52.176854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:52.177358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:52.177789 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:52.377709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:52.385738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:52.387406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:52.388570 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5865a17f-4313-4612-968a-f4ff695d6711 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.225406 Sep 28 12:31:52.389120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 465/921] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:52 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:53.040593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:53.041225 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:53.047608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.048115 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.048545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.049266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.049714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.050133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.175159 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:53.182841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-770dd5b0-6270-4f90-af4e-515851253156 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.146057 Sep 28 12:31:53.183940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 457/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:53 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:53.414197 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:53.414794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:53.421625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.422113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.422552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.423256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.423731 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.424142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.428272 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:53.557122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:53.565574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:53.567018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:53.568167 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f785b278-5e6e-419f-8e3f-6f777d0eb4a4 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.158019 Sep 28 12:31:53.568723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 466/923] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:53 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:54.206450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:54.207082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:54.213450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.213868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.214299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.214974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.215427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.215842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.347149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:54.354732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3b87db6e-a70d-460c-8030-1f9ecbcf94a6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.152113 Sep 28 12:31:54.355366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 458/924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:54 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:54.594588 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:54.595118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:54.601535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.602020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.602458 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.603152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.603607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.604033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.730972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:54.738975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:54.740411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:54.741578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3c12b141-ef73-4fb4-8370-7388d2723eee tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.151851 Sep 28 12:31:54.742128 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 467/925] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:54 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:55.378537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:55.379150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:55.385484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.386045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.386574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.387321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.387774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.388344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.525389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:55.533792 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7939e782-10cb-4cc3-8be8-9cc76bb89a07 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.159419 Sep 28 12:31:55.534360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 459/926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:55 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:55.585337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "name": "network-vif-plugged", "status": "completed", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:55.597577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.598314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.598697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.611598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] Creating event network-vif-plugged:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:31:55.616505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-6706286c-2640-49c1-8ddb-dbd54d412594 req-56ec741e-b579-4c50-ac37-690a5894af5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035062 Sep 28 12:31:55.617090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 468/927] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:55.766378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:55.766980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:55.772997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.773505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.773940 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.774625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.775069 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.775534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.912445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:55.920785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:55.922247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:55.923391 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-198ad413-0f0b-44e8-a3d5-7dc55df1811c tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.161462 Sep 28 12:31:55.923955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 460/928] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:55 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:56.558334 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:56.559032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:56.566053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:56.566541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:56.566962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:56.567651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:56.568097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:56.569341 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:56.713761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:56.721609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-091dc18f-c771-45cd-b582-2c37219b4d56 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.167471 Sep 28 12:31:56.722173 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 469/929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:56 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:56.949209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:56.949818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:56.956577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:56.957051 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:56.957519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:56.958194 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:56.958640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:56.959055 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.089891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:57.098699 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:57.100126 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:57.101291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a016375a-ae0f-4f14-9a07-e625e92ecf21 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.155979 Sep 28 12:31:57.101880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 461/930] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:56 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:57.631694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54de1c40-5bbc-4c85-a7e2-339655ec6716", "name": "network-vif-plugged", "status": "completed", "tag": "429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:31:57.641996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:57.642484 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:57.642918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.654848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] Creating event network-vif-plugged:429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0 for instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 on hv-cinder-84456 Sep 28 12:31:57.659921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-739576f6-2bfd-4798-a92d-961448c8fabd req-37eca3fe-461b-4007-ab90-de21f0c1fccc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Sep 28 12:31:57.660515 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 470/931] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:31:57.745665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:57.746276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:57.752835 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:57.753358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:57.753797 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.754491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:57.754945 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:57.755367 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.891086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:57.899497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-207e7737-664b-4cc4-b813-4e7c0cd1d24c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.158219 Sep 28 12:31:57.900206 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 462/932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:57 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:58.127869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:58.128557 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:58.134628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.135103 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.135539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:58.136214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.136661 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.137079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:58.298159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:58.306397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:58.307841 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:58.308999 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f0606eef-9cd2-4599-9923-90af38d97a94 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1730 microversion: 2.20 time: 0.185338 Sep 28 12:31:58.310152 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 471/933] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:58 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:31:58.922651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:58.923263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:58.929618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.930103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.930544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:58.931233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.931691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.932117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:59.061648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:59.069184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a62e6ac-648e-4a6e-9efe-33ac146448f1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1363 microversion: 2.1 time: 0.150417 Sep 28 12:31:59.069751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 463/934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:58 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:59.334707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:59.335323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:59.341919 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:59.342399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:59.342834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:59.343778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:59.344234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:59.344655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:59.471469 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:59.479494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:59.480940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:59.482710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0b9a1b16-f116-4faa-8061-2f6208d9b27f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1717 microversion: 2.20 time: 0.151928 Sep 28 12:31:59.483273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 472/935] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:31:59 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:32:00.094485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:00.095044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:00.097149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:00.103002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.103556 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.103988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.104690 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.105157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.105587 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.239082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:00.246744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-857755e4-1700-4c55-b370-29ceed17d8c3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1549 microversion: 2.1 time: 0.157531 Sep 28 12:32:00.247455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 464/936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:00 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:00.269833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:00.270332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:00.276253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.276742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.277207 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.277912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.279090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.279523 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.353770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3a3f2ad9-63b3-4828-a198-06d84674f3e1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087836 Sep 28 12:32:00.354369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 473/937] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:32:00 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:01.503293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54de1c40-5bbc-4c85-a7e2-339655ec6716", "tag": "429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:32:01.513171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:01.513643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:01.514096 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:01.525167 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] Creating event network-changed:429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0 for instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 on hv-cinder-84456 Sep 28 12:32:01.531255 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-8a825573-adea-4d4d-9e28-c01265983ad0 req-17c21fe6-382d-44bf-9b99-101aaa02dd9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031702 Sep 28 12:32:01.532060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 465/938] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:16.269467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:32:16.269992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Wed Sep 28 12:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/ips (ip 10.222.0.60) !!! Sep 28 12:32:16.270881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:16.271614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=37 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:16.275444 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:16.275931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:16.284694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:16.285202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:16.285638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:16.286355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:16.286810 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:16.287231 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:16.311151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-552a68f4-ea73-4262-980e-2af4c805c868 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/ips" status: 200 len: 150 microversion: 2.1 time: 0.043363 Sep 28 12:32:16.312441 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 474/939] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:32:16 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:17.642944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e6c6de5-5795-4110-9098-317d89c952dc"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:32:17.645444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:17.648187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:17.648821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=85 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:17.654461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:17.654939 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:17.655373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:17.656047 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:17.656515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:17.657526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:17.924933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4e03f64f-3c73-4b2b-bdc8-fe35940a801a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "POST /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286741 Sep 28 12:32:17.925756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 466/940] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:32:17 2022] POST /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:25.562028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:25.562535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:25.569460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.569943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.570386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.571074 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.571528 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.571948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.658563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lazy-loading 'services' on Instance uuid d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:32:25.729459 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e54a0da4-0546-4b6c-acb8-253eb318269b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments/3e6c6de5-5795-4110-9098-317d89c952dc" status: 202 len: 0 microversion: 2.1 time: 0.171160 Sep 28 12:32:25.730290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 475/941] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:32:25 2022] DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments/3e6c6de5-5795-4110-9098-317d89c952dc => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:32:25.739764 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:25.742228 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:25.749927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.750447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.750882 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.752257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.752717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.753205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.782725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-acf1b477-272b-4683-b4a1-d169e0482183 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Sep 28 12:32:25.783295 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 467/942] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:32:25 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:26.796072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:26.798464 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:26.805679 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.806166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.806605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.807297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.807756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.808185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.838121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-32dc018a-1c08-4a7c-a154-4344e53ebe90 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046370 Sep 28 12:32:26.838599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 476/943] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:32:26 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:32:26.901284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:26.901760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:26.907983 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.908455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.908890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.909598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.910043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.910462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.934644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:32:27.007905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cfe2f085-7a0f-4136-9b51-0238890ba4a5 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 204 len: 0 microversion: 2.1 time: 0.110153 Sep 28 12:32:27.008476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 468/944] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:26 2022] DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:32:27.016609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:27.017255 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:27.024031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:27.024514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:27.024950 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:27.025680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:27.026136 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:27.026561 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:27.151886 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:27.159610 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ada0ccb9-4e41-4506-a3dc-20f37fd26213 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1681 microversion: 2.1 time: 0.146641 Sep 28 12:32:27.160183 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 477/945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:27 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:28.184271 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:28.185063 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:28.192746 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:28.193340 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:28.193838 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:28.194590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:28.195107 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:28.195700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:28.326518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:28.334854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-109b35fc-af97-4b18-b4bd-53129600330b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1681 microversion: 2.1 time: 0.154855 Sep 28 12:32:28.335422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 469/946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:28 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:29.357915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:29.358464 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:29.364909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:29.365419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:29.365852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:29.366540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:29.366986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:29.367399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:29.565158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8429a502bca744fc9f5d5701fe9c766c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ceb72510849c9a1cce4cde67d06d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:29.573961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f3d41b41-9bf9-4977-917b-1d3ab46c7baa tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 200 len: 1681 microversion: 2.1 time: 0.219496 Sep 28 12:32:29.579655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 478/947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:29 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:29.932963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90eac6b-9262-46e2-bdbd-feb3d20bf4f5", "name": "network-vif-deleted", "tag": "023f2828-3c6a-4c22-9ce8-9e10c629d988"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:32:29.943441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:29.943958 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:29.944593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:29.958215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] Creating event network-vif-deleted:023f2828-3c6a-4c22-9ce8-9e10c629d988 for instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 on hv-cinder-84456 Sep 28 12:32:29.963589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-c8d144d7-1591-4c2f-ae19-f085ddedb35d req-c38cb1c5-b509-43c1-8940-aec6a9aafbe1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Sep 28 12:32:29.965342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 470/948] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:30.599805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:30.600460 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:30.606719 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:30.607203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:30.607634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:30.608590 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:30.609163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:30.609649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:30.625425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 HTTP/1.1 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:32:30.627256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:30.629080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'd90eac6b-9262-46e2-bdbd-feb3d20bf4f5'} Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:30.629929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:30.631265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:30.632413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:30.632413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-09ab9ba3-1fed-4563-ba90-6c80a45997b4 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 404 len: 111 microversion: 2.1 time: 0.034281 Sep 28 12:32:30.632413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 479/949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:30 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:30.638321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0f58177f-86d7-4247-b3bd-40ae9259291a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '.version_select at 0x7fa706c38ca0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:30.656704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0f58177f-86d7-4247-b3bd-40ae9259291a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473128238" status: 202 len: 0 microversion: 2.1 time: 0.022611 Sep 28 12:32:30.657304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 471/950] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 12:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473128238 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:32:32.408535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:32.409685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:32.415939 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.416416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.416842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.417549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.418005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.418421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.435633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 HTTP/1.1 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:32:32.437178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.438796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'd90eac6b-9262-46e2-bdbd-feb3d20bf4f5'} Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:32.439746 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.441683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.443412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:32.443412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3e069b6a-5db2-45b7-980c-5ecadbe78a6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 404 len: 111 microversion: 2.1 time: 0.033893 Sep 28 12:32:32.443412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 480/951] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:32 2022] DELETE /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:32.449284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:32.450012 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: d90eac6b-9262-46e2-bdbd-feb3d20bf4f5] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:32.457092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.457601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.458034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.458717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.459171 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.459594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.473677 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 HTTP/1.1 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:32:32.475286 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.476820 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'd90eac6b-9262-46e2-bdbd-feb3d20bf4f5'} Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:32.477753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. Sep 28 12:32:32.479187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:32.480549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:32.480549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3db30376-8944-45d6-b2e2-ff0e753379f1 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5" status: 404 len: 111 microversion: 2.1 time: 0.031774 Sep 28 12:32:32.480549 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 472/952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:32 2022] GET /compute/v2.1/servers/d90eac6b-9262-46e2-bdbd-feb3d20bf4f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:33.614856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:33.615331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:33.621646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.622120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.622550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.623225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.623670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.624084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.637385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 HTTP/1.1 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:32:33.638909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.640506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'f6bc4a06-8fe2-4961-986a-39cdd04d73b2'} Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:33.641376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.642589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.644042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:33.644042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7a9f0de0-bb96-448b-b495-6a438cf1da6a tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 404 len: 111 microversion: 2.1 time: 0.030090 Sep 28 12:32:33.644042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 481/953] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:33 2022] DELETE /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:33.648540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:33.649267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: f6bc4a06-8fe2-4961-986a-39cdd04d73b2] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:33.660406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.661013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.661629 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.662321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.662772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.663195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.679321 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 HTTP/1.1 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:32:33.680839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.682458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'f6bc4a06-8fe2-4961-986a-39cdd04d73b2'} Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:33.683308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. Sep 28 12:32:33.684855 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.686259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance f6bc4a06-8fe2-4961-986a-39cdd04d73b2 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:33.686259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-58d6e265-5f91-48cc-8bbc-8fec1b1c8d4f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2" status: 404 len: 111 microversion: 2.1 time: 0.037514 Sep 28 12:32:33.686259 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 473/954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:33 2022] GET /compute/v2.1/servers/f6bc4a06-8fe2-4961-986a-39cdd04d73b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:32:33.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:33.691419 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:33.697351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.697831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.698264 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.698954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.699406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.699826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.712972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa HTTP/1.1 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:32:33.714513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.716089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '52bf4bcb-fcb0-4571-ab62-a01a701e27aa'} Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:33.717259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.718989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.720569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:33.720569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b65d59e9-3f8e-4e5e-b720-12cda466154f tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 404 len: 111 microversion: 2.1 time: 0.028842 Sep 28 12:32:33.720569 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 482/955] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:33 2022] DELETE /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:33.725146 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:33.725754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 52bf4bcb-fcb0-4571-ab62-a01a701e27aa] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:33.731643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.732117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.732544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.733254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.733698 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.734122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.748184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa HTTP/1.1 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:32:33.749653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.751238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '52bf4bcb-fcb0-4571-ab62-a01a701e27aa'} Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:33.752150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. Sep 28 12:32:33.753804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:33.755333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 52bf4bcb-fcb0-4571-ab62-a01a701e27aa could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:33.755333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24c6c639-0a03-45d3-8b0d-18bc55890d80 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa" status: 404 len: 111 microversion: 2.1 time: 0.030510 Sep 28 12:32:33.755333 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 474/956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:33 2022] GET /compute/v2.1/servers/52bf4bcb-fcb0-4571-ab62-a01a701e27aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:34.895244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:34.895734 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:34.902073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.902548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.902976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.903656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.904105 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.904520 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.917864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba HTTP/1.1 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:32:34.919374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.920883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '58f4d7a5-a42f-4ce7-bf29-b689265cceba'} Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:34.921755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.922986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.925013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:34.925013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-fd9399f7-ffde-4421-a1d0-38e759e8f46b tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 404 len: 111 microversion: 2.1 time: 0.029367 Sep 28 12:32:34.925013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 483/957] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:34 2022] DELETE /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:34.929574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:34.930213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] [instance: 58f4d7a5-a42f-4ce7-bf29-b689265cceba] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:34.936436 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.936908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.937376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.938061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.938514 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.938931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.952097 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] HTTP exception thrown: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Request method failure captured: Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba HTTP/1.1 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyeJD1M8UQNouP_t4XJ6zgR3l36RmoCLaDKtPBQ1y66dNliJCrDyHIqghGNY3XTVTgnzZznbie5YMGvOdRcALvLMJry6q-P3537I-2iaIWA4bin0K9ut8FvKJmXAKwiqGyWHtBttYxfibUAB1583qOj3EP2qw-m4U3W3R8p2Z3vP3U Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:32:34.953634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8f9ceb72510849c9a1cce4cde67d06d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8f9ceb72510849c9a1cce4cde67d06d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8f9ceb72510849c9a1cce4cde67d06d2"}]}] Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 8f9ceb72510849c9a1cce4cde67d06d2 Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1695561581 Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 8429a502bca744fc9f5d5701fe9c766c Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1695561581-project Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.955354 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '58f4d7a5-a42f-4ce7-bf29-b689265cceba'} Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:34.956289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. Sep 28 12:32:34.957761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:32:34.959021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] Returning 404 to user: Instance 58f4d7a5-a42f-4ce7-bf29-b689265cceba could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:34.959021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aaa4454b-ca57-45bf-adcb-752a5c341234 tempest-AttachVolumeNegativeTest-1695561581 tempest-AttachVolumeNegativeTest-1695561581-project] 10.222.0.60 "GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba" status: 404 len: 111 microversion: 2.1 time: 0.029235 Sep 28 12:32:34.959021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 475/958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:34 2022] GET /compute/v2.1/servers/58f4d7a5-a42f-4ce7-bf29-b689265cceba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:33:06.988707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:06.991027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:06.993276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=20 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:06.994086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:06.998618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:06.999129 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:06.999644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.004821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.004821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.004821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.033892 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0de5b708-8a38-4a60-b3d1-fc2cefeb964a tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049383 Sep 28 12:33:07.034437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 484/959] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 12:33:06 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:07.100848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:07.101516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:07.103923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:07.104566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:07.111332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.111819 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.112241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.112933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.113411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.114087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.142307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:33:07.223024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c05ba872-f1c2-4a6d-8010-4ec0e542d9d9 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 204 len: 0 microversion: 2.20 time: 0.126198 Sep 28 12:33:07.223656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 476/960] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 12:33:07 2022] DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:33:07.232016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:07.232614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:07.238508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.239275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.239713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.240399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.240852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.241295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.543351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:07.552485 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:07.554033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:07.555241 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-975a1de4-6707-4b3f-bb9f-a87ab164ade7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.327038 Sep 28 12:33:07.555793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 485/961] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:07 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:33:08.581621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:08.582230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:08.589532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:08.590006 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:08.590435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:08.591288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:08.591740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:08.592157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:08.872380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:08.880308 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:08.882394 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:08.883559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cdaeeebf-dd83-4167-93e3-0dae899049f7 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1723 microversion: 2.20 time: 0.306347 Sep 28 12:33:08.884106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 477/962] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:08 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:33:09.908907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:09.909545 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:09.916887 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.917529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.918040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.918797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.919326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.919834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.020178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:10.030312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:10.033217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d7b7c68a699443aa5c0859094c265ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a396283cd8314a74bfd5e411c246cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:10.046420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-726136cc-aca4-412e-bd4f-3eb9f467420e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 200 len: 1656 microversion: 2.20 time: 0.141218 Sep 28 12:33:10.048362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f18682-4e17-44a1-8e5f-71e5179134b0", "name": "network-vif-deleted", "tag": "b2945645-b583-4bd9-b292-3f9cc72af67c"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:10.049405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 486/963] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:09 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:33:10.083232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.084142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.085193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.116615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] Creating event network-vif-deleted:b2945645-b583-4bd9-b292-3f9cc72af67c for instance 85f18682-4e17-44a1-8e5f-71e5179134b0 on hv-cinder-84456 Sep 28 12:33:10.129698 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-402de65f-dae8-4400-a584-99cfac8d1e8a req-da4f39a1-56ee-4590-bfc4-6d2ea1561045 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084853 Sep 28 12:33:10.132098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 478/964] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:33:11.076849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:11.077513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:11.085044 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.085579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.086018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.086711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.087166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.087591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.100820 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 HTTP/1.1 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:33:11.102379 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:11.104066 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '85f18682-4e17-44a1-8e5f-71e5179134b0'} Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:11.104998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:11.106526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.107872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:11.107872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4201ed8f-db06-4c41-a588-fa5f30547bde tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 404 len: 111 microversion: 2.20 time: 0.030805 Sep 28 12:33:11.107872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 487/965] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:11 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:33:11.113544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-65245aa2-10ac-4d17-b129-36b43a2d0626 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '.version_select at 0x7fa706c60c10>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:11.132334 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-65245aa2-10ac-4d17-b129-36b43a2d0626 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774442442" status: 204 len: 0 microversion: 2.20 time: 0.023007 Sep 28 12:33:11.132890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 479/966] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 28 12:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774442442 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:33:12.910366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:12.910925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:12.917778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.918335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.918774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.919514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.919993 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.920408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.941237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 HTTP/1.1 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:33:12.942804 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.944990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '85f18682-4e17-44a1-8e5f-71e5179134b0'} Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:12.945964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.947536 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.949252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:12.949252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4f78d01c-9b77-431d-b031-00a192dbd54f tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 404 len: 111 microversion: 2.20 time: 0.038436 Sep 28 12:33:12.949252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 488/967] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 12:33:12 2022] DELETE /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:33:12.954573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:12.955293 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 85f18682-4e17-44a1-8e5f-71e5179134b0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:12.962045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.962523 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.962954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.963638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.964086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.964505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.977785 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 HTTP/1.1 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:33:12.979410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.981170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '85f18682-4e17-44a1-8e5f-71e5179134b0'} Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:12.982172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. Sep 28 12:33:12.983648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:12.984932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 85f18682-4e17-44a1-8e5f-71e5179134b0 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:12.984932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e0a4c2ed-8f17-41d7-b81c-c00d5b734b3e tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0" status: 404 len: 111 microversion: 2.20 time: 0.030621 Sep 28 12:33:12.984932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 480/968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:12 2022] GET /compute/v2.1/servers/85f18682-4e17-44a1-8e5f-71e5179134b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:33:14.124839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:14.125363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:14.131644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.132121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.132548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.133277 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.133728 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.134144 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.147117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd HTTP/1.1 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:33:14.148640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.150280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '3ae6ec0b-f117-438a-8147-6b661b54accd'} Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:14.151308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.152765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.154389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:14.154389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-72d0c894-ed10-411a-abb0-ce8be7c55277 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 404 len: 111 microversion: 2.20 time: 0.029173 Sep 28 12:33:14.154389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 489/969] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 12:33:14 2022] DELETE /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:33:14.158241 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:14.158850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] [instance: 3ae6ec0b-f117-438a-8147-6b661b54accd] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:14.165434 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.165914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.166356 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.167037 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.167487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.167910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.181986 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] HTTP exception thrown: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Request method failure captured: Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd HTTP/1.1 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNDyYs99I92lTtyg5XPxJGOC8tiZ5lpoUrgMFhgmB8W23FrIcCGc8vE6_1uX5u_fZFgodaT0-owiDwgfqiklHDlnSHOcBHL9pcYV3lIM-c5BX2GVkKKYpxNWY3_y5wnOfjRXXAPTBiASZn5-Yw4kemKnIQ9HRucmuy5xL-0SkWtOG03c Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:33:14.183525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a396283cd8314a74bfd5e411c246cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a396283cd8314a74bfd5e411c246cc96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a396283cd8314a74bfd5e411c246cc96"}]}] Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: a396283cd8314a74bfd5e411c246cc96 Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383014335 Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 4d7b7c68a699443aa5c0859094c265ec Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383014335-project Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.185307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '3ae6ec0b-f117-438a-8147-6b661b54accd'} Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:14.186200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. Sep 28 12:33:14.187694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:33:14.188991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] Returning 404 to user: Instance 3ae6ec0b-f117-438a-8147-6b661b54accd could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:14.188991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-21222fd3-ef1a-4b31-b3e4-3a9dab12e096 tempest-AttachVolumeShelveTestJSON-1383014335 tempest-AttachVolumeShelveTestJSON-1383014335-project] 10.222.0.60 "GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd" status: 404 len: 111 microversion: 2.20 time: 0.030425 Sep 28 12:33:14.188991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 481/970] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 12:33:14 2022] GET /compute/v2.1/servers/3ae6ec0b-f117-438a-8147-6b661b54accd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:33:31.124028 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:31.125732 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:31.133906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=12 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:31.136811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=24 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:31.141161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.142201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.143020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.144648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.145362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.146369 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.182909 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-95b123df-1c07-410a-af2d-b2fbcd0b7cec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/ips" status: 200 len: 144 microversion: 2.1 time: 0.063318 Sep 28 12:33:31.183580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 490/971] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:33:31 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/ips => generated 144 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:33.937246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d973dfd7-3659-436b-ac27-f3360094771d"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:33.939770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:33.952987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:33.966117 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:33.987189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:33.990033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:33.991579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:33.994730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:33.995279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:33.995779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:34.412067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-26ac0ee5-5113-4001-b1b6-49a71e440fe4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478501 Sep 28 12:33:34.432013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 482/972] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:33:33 2022] POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:37.722196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3c20c757-5113-4e8b-b21c-9803c6548c31 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Action: 'create', calling method: .version_select at 0x7fa706a94c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1668387227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEefl0PmhhYe/evlMTTcqtveIhqtGtwmtLKFoEAUwanOdVscE3alMGIbDZWRCAFZ0zy2Z4ngezZamgfPLKKJnQEa6BH64WqbCEA4Jk6LAKwAWGQvCY52nV7bsI3dYbNpKg=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:37.741300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-3c20c757-5113-4e8b-b21c-9803c6548c31 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for project d73c25391e8044c2ac3678317021732d. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:33:37.749637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-3c20c757-5113-4e8b-b21c-9803c6548c31 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for user 5b723fcdba1d4b26bd0cf604d59f8d8c and project d73c25391e8044c2ac3678317021732d. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:33:37.784392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3c20c757-5113-4e8b-b21c-9803c6548c31 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.343662 Sep 28 12:33:37.785945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 491/973] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:33:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:42.265654 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:42.274683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.275179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.275751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.343976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Going to try to stop instance {{(pid=120392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 12:33:42.387933 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-336dc566-ce7b-4ee0-9b58-f55e5cc49a43 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action" status: 202 len: 0 microversion: 2.1 time: 0.126865 Sep 28 12:33:42.388516 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 483/974] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:33:42 2022] POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:33:42.394543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:42.404664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:42.405472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:42.415221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.415930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.416406 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.417117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.417593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.418008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.605764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:42.617597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-41e4500c-cd97-4d5f-9884-4b58291d82ba tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.224153 Sep 28 12:33:42.618437 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 492/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:42 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:43.643763 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:43.644468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:43.650971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.651398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.651844 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.652565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.653051 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.653508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.787960 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:43.796453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a45413e-0951-429a-ab38-2fa8b59c44ac tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.157379 Sep 28 12:33:43.797443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 484/976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:43 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:44.819871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:44.820470 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:44.826962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.827453 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.827889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.828577 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.829033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.829479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.961394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:44.971763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-defbd0de-352b-44ac-8daf-1049e2605392 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.155853 Sep 28 12:33:44.972330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 493/977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:44 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:45.996713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:45.997357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:46.005749 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:46.006930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:46.007486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:46.008287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:46.008954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:46.009456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:46.150238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:46.158512 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7165f995-62f7-4411-8034-b3aef5a46844 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.165675 Sep 28 12:33:46.159074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 485/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:45 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:47.182925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:47.183538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:47.190140 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:47.190630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:47.191071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:47.191772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:47.192233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:47.192657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:47.338628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:47.347564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c8630604-03d3-49b8-ba5b-08688f6778ca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.169204 Sep 28 12:33:47.348133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 494/979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:47 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:48.372526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:48.373099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:48.379553 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.380031 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.380465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.381328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.381821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.382258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.522954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:48.531582 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aaaaef6d-d7f9-482f-9f37-307c39b654e0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.162952 Sep 28 12:33:48.532154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 486/980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:48 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:49.555323 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:49.555965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:49.557789 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:49.563656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.564288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.564776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.565488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.566092 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.566712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.697263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:49.705593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-04e56882-11da-4edd-85d8-0e1f97dfc436 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.154282 Sep 28 12:33:49.706155 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 495/981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:49 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:50.731092 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:50.731674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:50.737968 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.738442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.738872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.739545 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.740013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.740427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.870239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:50.878240 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-95a83199-3cb6-4387-b4af-4fb765575d7c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.151771 Sep 28 12:33:50.878793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 487/982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:50 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:51.902354 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:51.902996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:51.909405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.909890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.910326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:51.911018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.911471 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.911895 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:52.047752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:52.056818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f42962a7-881f-44d2-bdae-800d5bfe492b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.157725 Sep 28 12:33:52.057514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:51 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:53.079790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:53.080519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:53.087269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:53.087836 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:53.088821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:53.089601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:53.090118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:53.090599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:53.227906 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:53.236942 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d3dcc38-a2ae-4022-8275-95a4a0049169 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.160821 Sep 28 12:33:53.237567 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 488/984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:53 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:54.260815 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:54.261446 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:54.267889 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.268411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.268845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.269565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.270022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.270445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.395876 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:54.404061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e0aa5cf0-c30c-4b4c-81b6-e75544e01198 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.147140 Sep 28 12:33:54.404613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 497/985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:54 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:55.428584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:55.429220 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:55.435554 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.436026 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.436455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.437151 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.437599 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.438015 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.563789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:55.571931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f306a43f-46e7-4306-a16b-42d05e702047 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.147163 Sep 28 12:33:55.572507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 489/986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:55 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:56.595745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:56.596290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:56.603490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.604029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.604475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.605187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.605646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.606071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.734821 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:56.743142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e5df550b-b358-4a2b-8cbc-9a990bd62f09 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.151509 Sep 28 12:33:56.743702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 498/987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:56 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:57.766771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:57.767372 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:57.773881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:57.774362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:57.774796 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:57.775491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:57.776131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:57.776728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:57.997877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:58.006821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d9420e63-3374-40ea-95de-171007a52b87 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1722 microversion: 2.1 time: 0.243853 Sep 28 12:33:58.007408 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 490/988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:57 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:59.032039 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:59.032652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:59.039098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.039579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.040017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.040710 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.041225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.041966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.174524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:59.196989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e0c5619e-2abe-47c5-abd8-7223a71700bf tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1699 microversion: 2.1 time: 0.169050 Sep 28 12:33:59.198187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 499/989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:59 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:59.220552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:59.227044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.227631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.228149 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.250501 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Going to try to start instance {{(pid=120392) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 12:33:59.298740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-48b2185f-df2c-4681-a4d0-d32bf2f11366 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action" status: 202 len: 0 microversion: 2.1 time: 0.082125 Sep 28 12:33:59.299373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 491/990] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:33:59 2022] POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:33:59.308967 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:59.309839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:59.317281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.318509 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.319370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.320083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.320546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.321014 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.493186 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:59.503133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-379ae4b6-ebf1-4b97-96b7-7223126ec6d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1708 microversion: 2.1 time: 0.198925 Sep 28 12:33:59.503794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 500/991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:59 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1708 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:00.528060 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:00.528886 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:00.535566 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:00.536142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:00.536594 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:00.537322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:00.537783 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:00.538213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:00.682466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:00.691717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f63b06b7-a622-4126-a3e9-8b2d4f8a7219 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1708 microversion: 2.1 time: 0.168797 Sep 28 12:34:00.692298 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 492/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:00 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:01.717963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:01.718574 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:01.720709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:01.725966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.726456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.726899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.727597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.728055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.728483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.857076 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:01.865530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c9883117-312f-439e-b8eb-b00368885e06 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1712 microversion: 2.1 time: 0.152321 Sep 28 12:34:01.866105 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 501/993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:01 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:04.152790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1139937252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1668387227", "security_groups": [{"name": "tempest-secgroup-smoke-1396524423"}], "block_device_mapping_v2": [{"uuid": "cccad23b-d542-410c-b63c-9c493e3427fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf8da1f-c122-40d9-8bf4-a166b5233ca8"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:34:04.164138 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=23 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:04.280661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] validate_networks() for [('cbf8da1f-c122-40d9-8bf4-a166b5233ca8', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:34:04.649688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:34:04.650109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:34:04.650608 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:34:04.651013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:34:04.651421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:34:04.660564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.661040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.661502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.662219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.662667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.663083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.670435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:04.683012 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:34:04.687094 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for user 5b723fcdba1d4b26bd0cf604d59f8d8c and project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:34:04.743897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:34:04.746245 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cccad23b-d542-410c-b63c-9c493e3427fa',volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:34:04.874034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [3cfd0f63-f784-4213-bd22-836a697309ab] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:34:05.880750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [3cfd0f63-f784-4213-bd22-836a697309ab] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37892. Sep 28 12:34:05.884954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d5a49f6f-d2c0-469c-bd92-f81e43b01a2f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.736736 Sep 28 12:34:05.885717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 493/994] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:34:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 12:34:05.897233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-77d35dea-edf2-46c0-a37e-adb3bf2e582a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:05.897848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-77d35dea-edf2-46c0-a37e-adb3bf2e582a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:05.949240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-77d35dea-edf2-46c0-a37e-adb3bf2e582a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:05.956959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-77d35dea-edf2-46c0-a37e-adb3bf2e582a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1095 microversion: 2.1 time: 0.063534 Sep 28 12:34:05.957563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 502/995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:05 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:06.980773 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ba169c2d-3d34-48a3-b93e-8d5b1fa6d020 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:06.982287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ba169c2d-3d34-48a3-b93e-8d5b1fa6d020 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:07.035306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ba169c2d-3d34-48a3-b93e-8d5b1fa6d020 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:07.043375 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ba169c2d-3d34-48a3-b93e-8d5b1fa6d020 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1095 microversion: 2.1 time: 0.067251 Sep 28 12:34:07.044056 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 494/996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:06 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:08.067196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-74b8ab69-f335-4c49-a03b-bab495633bd4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:08.067786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-74b8ab69-f335-4c49-a03b-bab495633bd4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:08.127888 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-74b8ab69-f335-4c49-a03b-bab495633bd4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:08.135257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-74b8ab69-f335-4c49-a03b-bab495633bd4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1095 microversion: 2.1 time: 0.071830 Sep 28 12:34:08.137996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 503/997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:08 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:09.160204 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e49266ff-22d4-4ba8-8a52-5e0490d6fd87 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:09.160816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e49266ff-22d4-4ba8-8a52-5e0490d6fd87 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:09.219120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e49266ff-22d4-4ba8-8a52-5e0490d6fd87 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:09.226205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e49266ff-22d4-4ba8-8a52-5e0490d6fd87 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1095 microversion: 2.1 time: 0.069774 Sep 28 12:34:09.226781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 495/998] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:09 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:10.248626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:10.249261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:10.256240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.256795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.257261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.257959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.258415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.258837 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.319595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:10.327682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bb257faf-b81e-4f26-a9c9-a767e1e0adb2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1145 microversion: 2.1 time: 0.083399 Sep 28 12:34:10.328238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 504/999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:10 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:11.352769 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:11.354127 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:11.362435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.363233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.364032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.364944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.366214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.366799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.466630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:11.476262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-972187ef-4410-443a-9780-0f66d1761be4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1211 microversion: 2.1 time: 0.128961 Sep 28 12:34:11.477416 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 496/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:11 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:12.502333 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:12.503507 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:12.510041 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.510529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.510962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.512018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.512584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.513266 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.517357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=67 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:12.737098 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:12.745005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-897d97e7-47a2-4f15-abbc-be2db1db7e2e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.248626 Sep 28 12:34:12.745961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 505/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:12 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:13.072761 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de20408b-1f47-488b-976f-f41706a8509f", "tag": "0db4c4f8-4e18-4c3f-afdd-33f13f47b330"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:34:13.085497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.085974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.086399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.100478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] Creating event network-changed:0db4c4f8-4e18-4c3f-afdd-33f13f47b330 for instance de20408b-1f47-488b-976f-f41706a8509f on hv-cinder-84456 Sep 28 12:34:13.105619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-6faeec84-9f86-4717-9de4-c8211ae3e149 req-a59701eb-a522-4ee7-a1df-0fd68b84ed97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228421 Sep 28 12:34:13.106804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 497/1002] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:34:13.768795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:13.769461 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:13.775716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.776192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.776622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.777328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.777781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.778199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.911867 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:13.920077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-70f09c1b-7555-451e-a6d1-7d00e498eddc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.155184 Sep 28 12:34:13.920635 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 506/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:13 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:14.944575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:14.945415 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:14.948119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:14.955285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:14.955955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:14.956571 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:14.957455 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:14.958058 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:14.958519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:15.091907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:15.099696 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f658c1cb-4948-494f-8525-0b5efd9b67d5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.159840 Sep 28 12:34:15.100258 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 498/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:14 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:16.123784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:16.124386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:16.130802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.131275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.131702 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.132380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.132829 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.133280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.266387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:16.274029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-181302b4-8f79-4767-afe6-824c02ffee9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.154771 Sep 28 12:34:16.274589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 507/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:16 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:17.297338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:17.297980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:17.304426 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.304918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.305390 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.306088 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.306540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.306962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.446419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:17.454044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5d6e423b-43b2-43bf-b9b2-4b3b3f5c2935 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.160741 Sep 28 12:34:17.454601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 499/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:17 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:18.476920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:18.477571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:18.479818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:18.485111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.485624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.486060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:18.486752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.487214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.487638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:18.622121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:18.629741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a82e83c1-cd3b-472d-8321-327896917b2b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.156708 Sep 28 12:34:18.630302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 508/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:18 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:19.651790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:19.652406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:19.655389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:19.660755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:19.661278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:19.661716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:19.662406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:19.662862 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:19.663329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:19.793674 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:19.802020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea17a05e-418e-4c5d-8aa1-0e5272d5724c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.154139 Sep 28 12:34:19.802585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 500/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:19 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:20.824073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:20.824685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:20.831933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.832425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.832882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:20.833627 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.834089 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.834514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:20.975756 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:20.985104 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d7bdfd43-128a-4d70-9476-dd26350b64b2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.165193 Sep 28 12:34:20.985707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 509/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:20 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:22.007686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:22.008388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:22.014961 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.015453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.015957 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.016717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.017221 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.017696 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.156539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:22.164114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77d11c15-89a2-4719-a313-99b4b2628b8a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.160334 Sep 28 12:34:22.164671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 501/1010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:22 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:23.187857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:23.188405 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:23.194802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.195290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.195726 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.196414 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.196871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.197325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.328064 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:23.335630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b1798a47-cbcd-4031-b0c5-ae66bf7218e3 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.152235 Sep 28 12:34:23.336188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 510/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:23 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:24.223740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de20408b-1f47-488b-976f-f41706a8509f", "name": "network-vif-plugged", "status": "completed", "tag": "0db4c4f8-4e18-4c3f-afdd-33f13f47b330"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:34:24.233837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.234468 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.235457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.246644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] Creating event network-vif-plugged:0db4c4f8-4e18-4c3f-afdd-33f13f47b330 for instance de20408b-1f47-488b-976f-f41706a8509f on hv-cinder-84456 Sep 28 12:34:24.251613 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dab0037b-12d7-4591-874e-0df73dbfaca2 req-47ada638-24d9-453b-b7e2-64c4c6fecbc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087608 Sep 28 12:34:24.252210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 502/1012] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:34:24.358296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:24.358928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:24.365339 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.365823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.366253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.366935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.367382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.367795 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.540060 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:24.548639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5ff45f3f-7e63-4e0c-b93b-e58a385c8c5e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.194021 Sep 28 12:34:24.549356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 511/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:24 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:25.572291 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:25.572973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:25.579447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.579924 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.580355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.581027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.581510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.581931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.709418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:25.718017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ae304f6e-761c-4b4c-845c-0163acad7e2a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1267 microversion: 2.1 time: 0.150497 Sep 28 12:34:25.718574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 503/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:25 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:26.741268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:26.741883 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:26.749003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.749511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.749948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.750635 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.751091 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.751517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.882093 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:26.889824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b96270d8-c7f7-4ecf-a4e5-5367face5019 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1454 microversion: 2.1 time: 0.152448 Sep 28 12:34:26.890387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 512/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:26 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:26.911756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:26.912358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:26.918880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.919358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.919788 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.920464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.920912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.921362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:27.051197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:27.058772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-25e51710-7b7f-4e99-93f1-60302c388de7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1454 microversion: 2.1 time: 0.150794 Sep 28 12:34:27.059850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 504/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:26 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:29.053023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de20408b-1f47-488b-976f-f41706a8509f", "tag": "0db4c4f8-4e18-4c3f-afdd-33f13f47b330"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:34:29.062541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:29.063107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:29.063539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:29.074314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] Creating event network-changed:0db4c4f8-4e18-4c3f-afdd-33f13f47b330 for instance de20408b-1f47-488b-976f-f41706a8509f on hv-cinder-84456 Sep 28 12:34:29.077957 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR oslo.messaging._drivers.impl_rabbit [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] [829df8e3-3138-48a0-b3e6-ed2b3cfdf4eb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:34:30.086607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] [829df8e3-3138-48a0-b3e6-ed2b3cfdf4eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 38140. Sep 28 12:34:30.091019 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-cf34530a-501c-419a-8f7a-26629c1ec9a1 req-2d9c3995-194b-47a0-b783-bc30d53ee48d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.108474 Sep 28 12:34:30.091806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 513/1017] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:35:01.778956 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-607446263", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "networks": [{"uuid": "672633cd-4d82-43a9-8eec-15b6eada112f"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:01.787590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:01.788238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=47 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:01.834230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] validate_networks() for [('672633cd-4d82-43a9-8eec-15b6eada112f', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:35:02.224305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:35:02.224724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:35:02.225224 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:35:02.225638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:35:02.226079 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:35:02.234910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:02.235387 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:02.235817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:02.236542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:02.236993 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:02.237447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:02.254504 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Getting quotas for project e6eccd42ceef4259b48149c9835fc73b. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:35:02.258563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Getting quotas for user 42450ebae9bb445dba460ea02832a173 and project e6eccd42ceef4259b48149c9835fc73b. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:35:02.269923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:35:02.272170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:35:02.318628 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d9e7855d-6c2d-4b82-b3c6-d0991fe21570 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543716 Sep 28 12:35:02.319506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 505/1018] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:35:02.328549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=29 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:02.329396 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=49 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:02.333626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-487dca00-de31-4854-9421-a93256ee827e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:02.334512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-487dca00-de31-4854-9421-a93256ee827e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:02.397673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-487dca00-de31-4854-9421-a93256ee827e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:02.404630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-487dca00-de31-4854-9421-a93256ee827e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1218 microversion: 2.1 time: 0.077909 Sep 28 12:35:02.405571 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 514/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:02 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:03.428347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:03.428950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:03.435480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.435976 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.436413 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.437102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.437575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.437992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.503929 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:03.512130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cd53853b-35c9-4ad2-997a-734975641b74 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1278 microversion: 2.1 time: 0.088210 Sep 28 12:35:03.513050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 506/1020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:03 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:04.535346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:04.535986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:04.543371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.543858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.544325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.545027 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.546431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.546708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.740672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:04.748898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0390430a-2e85-4bd0-9eb8-ecbb579a8022 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.217126 Sep 28 12:35:04.749609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 515/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:04 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:04.828589 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83b2749-940b-4530-bd2e-54836432bf22", "tag": "840db46a-f9db-4295-9a66-6546538ed638"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:04.840191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.840729 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.841350 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.855124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] Creating event network-changed:840db46a-f9db-4295-9a66-6546538ed638 for instance d83b2749-940b-4530-bd2e-54836432bf22 on hv-cinder-84456 Sep 28 12:35:04.860034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-944b05e3-298d-4436-8844-71eeb707341d req-9a8bd9e5-3b8e-4a44-a708-71671d0b4859 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036039 Sep 28 12:35:04.860632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 507/1022] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:35:05.771598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:05.772210 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:05.778776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.779260 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.780589 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.781343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.781800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.782229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.908768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:05.916310 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f1a0cc83-5154-4f89-a3f8-d1f87d92fd2e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.148626 Sep 28 12:35:05.916871 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 516/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:05 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:06.940897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:06.941617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:06.948106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.948579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.949008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:06.949713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.950156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.950578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:07.076912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:07.084424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ffd3482c-353a-403d-9cc0-9d71e371a4c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.148404 Sep 28 12:35:07.084977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 508/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:06 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:08.107517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:08.108157 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:08.114449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:08.114929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:08.115362 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:08.116055 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:08.116508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:08.116930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:08.248111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:08.256736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-dbc4a1d5-fffe-447b-b111-8c77f37211ab tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.153468 Sep 28 12:35:08.257336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 517/1025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:08 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:09.280555 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:09.281177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:09.287419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.287890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.288316 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:09.288989 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.289461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.289876 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:09.418496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:09.426477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6774e4b5-a483-40cb-b1a8-497d762f5312 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.150342 Sep 28 12:35:09.427045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 509/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:09 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:10.338695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83b2749-940b-4530-bd2e-54836432bf22", "name": "network-vif-plugged", "status": "completed", "tag": "840db46a-f9db-4295-9a66-6546538ed638"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:10.349585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:10.350174 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:10.350505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.362328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] Creating event network-vif-plugged:840db46a-f9db-4295-9a66-6546538ed638 for instance d83b2749-940b-4530-bd2e-54836432bf22 on hv-cinder-84456 Sep 28 12:35:10.367274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-194e2d0b-e99e-4048-bb4e-2c82a0059688 req-7ea221f3-6567-48fd-aeba-0c1071aaf9e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032301 Sep 28 12:35:10.367927 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 518/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:35:10.449869 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:10.450473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:10.456980 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:10.457495 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:10.457946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.458637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:10.459137 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:10.459557 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.593070 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:10.601017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a0e837d9-9c50-489b-a0e2-8839f57228f9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.154933 Sep 28 12:35:10.601665 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 510/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:10 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:11.625617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:11.626308 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:11.632467 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.632951 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.633415 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.634104 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.634558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.634978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.764750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:11.772335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5eb9ce99-3b24-4354-a728-d9682c211596 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1318 microversion: 2.1 time: 0.151761 Sep 28 12:35:11.772897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 519/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:11 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:12.794083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:12.794683 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:12.797680 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:12.798435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:12.804382 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.804850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.805310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.806034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.806484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.806900 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.933184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:12.940614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f159d3f0-2332-442f-a1c6-f637e5c950bc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1506 microversion: 2.1 time: 0.150393 Sep 28 12:35:12.941200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 511/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:12 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:21.679095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:21.679695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:21.681587 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:21.683062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=14 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:21.689084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:21.689581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:21.690017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:21.690805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:21.691304 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:21.691744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:21.779997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lazy-loading 'services' on Instance uuid 54de1c40-5bbc-4c85-a7e2-339655ec6716 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:35:21.854038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1281da13-df56-4adf-a930-52f5c7bb57a7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments/d973dfd7-3659-436b-ac27-f3360094771d" status: 202 len: 0 microversion: 2.1 time: 0.178752 Sep 28 12:35:21.854626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 520/1031] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:35:21 2022] DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments/d973dfd7-3659-436b-ac27-f3360094771d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:35:24.040896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:24.043331 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:24.044095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=34 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:24.051428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.051913 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.052347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.074925 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Going to try to stop instance {{(pid=120392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 12:35:24.116424 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4f2fb39-58f4-44fb-8a8c-3c687e65c355 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action" status: 202 len: 0 microversion: 2.1 time: 0.078932 Sep 28 12:35:24.117024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 512/1032] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:35:24 2022] POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:35:24.126916 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:24.127707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:24.134974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.136111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.136809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.137544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.138023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.138645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.269585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:24.277393 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-85521c1a-0970-4065-ba0b-c6b97aeb498b tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.155202 Sep 28 12:35:24.277952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 521/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:24 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:25.300732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:25.301456 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:25.307966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.308437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.308868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.309582 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.310052 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.310466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.444274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:25.451866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6dda010d-5c58-4c5a-b836-6088da4a4723 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.155327 Sep 28 12:35:25.452432 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 513/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:25 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:26.475761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:26.476398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:26.482769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.483252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.483685 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:26.485095 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.485640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.486063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:26.622641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:26.631067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-388cc8a7-e25b-4cdc-aed9-7343dfcbcb39 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.159221 Sep 28 12:35:26.631653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 522/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:26 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:27.654565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:27.655175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:27.661678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:27.662157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:27.662593 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:27.663277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:27.663756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:27.664179 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:27.788044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:27.795794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-abd88918-ee4c-4fbf-933f-73bbc5a82716 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.145073 Sep 28 12:35:27.796358 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 514/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:27 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:28.819670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:28.820283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:28.826655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.827139 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.827575 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.828831 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.829336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.829763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.958518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:28.966292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-db9a2db3-3538-4056-87d3-ccdaa9e4dcdc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.150563 Sep 28 12:35:28.967118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 523/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:28 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:29.991313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:29.991910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:29.997762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.998233 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:29.998666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:29.999349 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.999840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:30.000262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:30.126530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:30.134042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-75832759-79f2-48a0-bb64-b66461749467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.146711 Sep 28 12:35:30.134663 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 515/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:29 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:31.158900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:31.159538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:31.165641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.166118 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.166550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:31.167234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.167683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.168100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:31.294944 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:31.303558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f98aa38c-b4f5-494d-b972-55106afdc8cd tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.149003 Sep 28 12:35:31.304120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 524/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:31 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:32.327366 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:32.328172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:32.334462 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:32.334937 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:32.335362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:32.336039 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:32.336485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:32.336898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:32.466838 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:32.474488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-478d9cf4-a208-49a1-9831-396944fd30a0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.150896 Sep 28 12:35:32.475045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 516/1040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:32 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:33.497476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:33.498103 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:33.505199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.505680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.506111 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:33.506899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.507354 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.507781 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:33.510375 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:33.636786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:33.644672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f593c607-ed59-4086-af3d-c4e65e106032 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.151143 Sep 28 12:35:33.645252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 525/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:33 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:34.668730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:34.669309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:34.676209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:34.676687 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:34.677122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:34.677948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:34.678521 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:34.679002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:34.803799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:34.811437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea486e36-6083-49e6-ae8c-9d6118c28178 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.146809 Sep 28 12:35:34.812574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 517/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:34 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:35.835714 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:35.836248 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:35.842890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:35.843905 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:35.844335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:35.845013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:35.845490 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:35.845918 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:35.971622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:35.979337 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c795caf3-5dee-4f0f-9f52-84b31fd53c15 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.147581 Sep 28 12:35:35.979906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 526/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:35 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:36.564678 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42e1fa97-2aa7-4016-be2e-88acb3479c3e", "device": "/dev/sdb"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:36.567734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:36.574203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:36.574686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:36.575121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:36.575812 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:36.576267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:36.576709 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:36.830515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d09d07ae-4a04-40df-bbd6-bff37cc72abc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "POST /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270087 Sep 28 12:35:36.831152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 518/1044] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:35:36 2022] POST /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:35:37.003511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:37.004018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:37.006479 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:35:37.006613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Wed Sep 28 12:35:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 (ip 10.222.0.60) !!! Sep 28 12:35:37.013754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:37.014233 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:37.014665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:37.015839 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:37.016290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:37.016707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:37.143823 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:37.151421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-60f21933-dc19-4d14-a212-cb62c4e1458a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.151862 Sep 28 12:35:37.151978 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 527/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:36 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:38.176734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:38.177458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:38.183731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:38.184215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:38.184647 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:38.185364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:38.185827 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:38.186247 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:38.318270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:38.325966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d93fbc0-517a-42b6-8a67-8dba7f2258e2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.154800 Sep 28 12:35:38.326526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 519/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:38 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:39.351811 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:39.352368 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:39.359265 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:39.359742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:39.360220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:39.360908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:39.361395 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:39.361819 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:39.489510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:39.497171 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a36b5a05-a2d3-43b1-b65e-9cd860824299 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1676 microversion: 2.1 time: 0.149269 Sep 28 12:35:39.497733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 528/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:39 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:40.520711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:40.521346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:40.527732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.528208 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.528639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.529357 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.529811 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.530235 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.663264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:40.670842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-81ade98d-393e-42bc-b75a-123ba196afa2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1653 microversion: 2.1 time: 0.153990 Sep 28 12:35:40.671926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 520/1048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:40 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:40.694678 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:35:40.700966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.701489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.701929 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.764696 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Going to try to start instance {{(pid=120393) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 12:35:40.806755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-70a3d8cf-03fe-469b-955f-1a2928f6ada5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action" status: 202 len: 0 microversion: 2.1 time: 0.115727 Sep 28 12:35:40.807370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 529/1049] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 12:35:40 2022] POST /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:35:40.816467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:40.817077 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:40.823470 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.823995 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.824421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.825280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.826186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.826186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.969058 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:40.976825 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aea5761a-3ed4-4ac0-ab05-3db48679f209 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1662 microversion: 2.1 time: 0.164997 Sep 28 12:35:40.977618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 521/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:40 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:42.002807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:42.004403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:42.011524 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:42.012018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:42.012454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:42.013189 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:42.013652 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:42.014083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:42.140350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:42.148013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9e01b2e7-9907-4f6c-b2ae-bd71358fb859 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1662 microversion: 2.1 time: 0.150152 Sep 28 12:35:42.148587 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 530/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:41 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:43.171831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:43.173708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:43.180440 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:43.181010 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:43.181547 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:43.182324 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:43.182859 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:43.183656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:43.312857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:43.320847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7e5ea55f-1d6a-4d43-8a84-44f2091d4862 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1666 microversion: 2.1 time: 0.153035 Sep 28 12:35:43.321446 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 522/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:43 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:36:03.644224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:03.644743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:03.646860 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=22 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:03.647645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:03.653123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:03.653629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:03.654063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:03.654754 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:03.655208 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:03.655631 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:03.737850 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'services' on Instance uuid d83b2749-940b-4530-bd2e-54836432bf22 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:36:03.814252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9219a557-3260-41a4-b283-8ad6746722cc tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22/os-volume_attachments/42e1fa97-2aa7-4016-be2e-88acb3479c3e" status: 202 len: 0 microversion: 2.1 time: 0.174600 Sep 28 12:36:03.815097 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 531/1053] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:36:03 2022] DELETE /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22/os-volume_attachments/42e1fa97-2aa7-4016-be2e-88acb3479c3e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:36:04.946157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:04.946672 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:04.949260 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=22 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:04.950046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:04.955508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:04.955987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:04.956427 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:04.957109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:04.957580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:04.957999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:04.983927 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:36:05.055856 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-58065720-bd93-41a3-be30-a63ce94fe4e9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 204 len: 0 microversion: 2.1 time: 0.113239 Sep 28 12:36:05.056752 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 523/1054] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:36:04 2022] DELETE /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:36:05.065920 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:05.066618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:05.072897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:05.073426 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:05.073858 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:05.074543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:05.075020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:05.078054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:05.206121 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:05.213699 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3b33900a-c2ed-420a-b23d-04f905cad375 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1512 microversion: 2.1 time: 0.152473 Sep 28 12:36:05.214261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 532/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:05 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:06.236994 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:06.237720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:06.244067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:06.244557 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:06.244992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:06.245718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:06.246174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:06.246596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:06.373664 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:06.381754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9c01ad5a-fe32-4b21-b393-ba61122c1ee9 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1512 microversion: 2.1 time: 0.149097 Sep 28 12:36:06.382309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 524/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:06 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:07.405991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:07.406778 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:07.413083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:07.413600 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:07.414036 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:07.414743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:07.415227 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:07.415655 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:07.637189 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:07.644913 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6cb47d90-c222-4d2f-8c89-6679ea353863 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1512 microversion: 2.1 time: 0.242856 Sep 28 12:36:07.645516 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 533/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:07 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:07.904701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83b2749-940b-4530-bd2e-54836432bf22", "name": "network-vif-deleted", "tag": "840db46a-f9db-4295-9a66-6546538ed638"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:07.916720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:07.917263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:07.917728 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:07.930518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] Creating event network-vif-deleted:840db46a-f9db-4295-9a66-6546538ed638 for instance d83b2749-940b-4530-bd2e-54836432bf22 on hv-cinder-84456 Sep 28 12:36:07.935943 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-03409ed7-2d0e-4e21-9c52-dde8cdf00de2 req-ac8d16d9-ab49-4a25-bc06-f211cc80e8d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Sep 28 12:36:07.936699 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 525/1058] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:36:08.668472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:08.669119 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:08.675817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:08.676493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:08.676938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:08.677666 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:08.678126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:08.678546 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:08.710762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:08.711202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:08.711637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:08.712084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'fault' on Instance uuid d83b2749-940b-4530-bd2e-54836432bf22 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:36:08.751848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:08.759930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5f62d3bc-b8bc-4f0e-bbda-a2ed6a83bbd0 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 200 len: 1308 microversion: 2.1 time: 0.095627 Sep 28 12:36:08.760513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 534/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:08 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:09.784203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:09.784888 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: d83b2749-940b-4530-bd2e-54836432bf22] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:09.791435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:09.791904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:09.792329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:09.793001 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:09.793482 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:09.793899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:09.806831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] HTTP exception thrown: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Request method failure captured: Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 HTTP/1.1 Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND90lOp4k5GSA6TfbntatOwtydxd8-wc53FxYaZImc5mfoRCxyZLK2VkNSZMi2CMPYjABbeuY3LXgh2lX93VxcXcJisBSDrmBUsfgrbqjyTZmgFz2_g5wuU7pcjbmnYYI15JOgHQCYbnT5gW-YahqdDsaZahuynBb6LebGldtI-3oNc Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: e6eccd42ceef4259b48149c9835fc73b Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:36:09.808412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6eccd42ceef4259b48149c9835fc73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6eccd42ceef4259b48149c9835fc73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6eccd42ceef4259b48149c9835fc73b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6eccd42ceef4259b48149c9835fc73b"}]}] Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: e6eccd42ceef4259b48149c9835fc73b Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesSnapshotTestJSON-1154636101-project Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 42450ebae9bb445dba460ea02832a173 Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154636101-project Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. Sep 28 12:36:09.810178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'd83b2749-940b-4530-bd2e-54836432bf22'} Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:36:09.811227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. Sep 28 12:36:09.812938 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:36:09.814319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Returning 404 to user: Instance d83b2749-940b-4530-bd2e-54836432bf22 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:36:09.814319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f9595b8f-5970-447e-a0ec-57514a4692c1 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22" status: 404 len: 111 microversion: 2.1 time: 0.030550 Sep 28 12:36:09.814319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 526/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:09 2022] GET /compute/v2.1/servers/d83b2749-940b-4530-bd2e-54836432bf22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:36:19.648155 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1130401907", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "networks": [{"uuid": "672633cd-4d82-43a9-8eec-15b6eada112f"}]}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:19.657898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=10 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:19.658538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:19.706234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] validate_networks() for [('672633cd-4d82-43a9-8eec-15b6eada112f', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:36:20.106662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:36:20.107093 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:36:20.107568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:36:20.107979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:36:20.108424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:36:20.117238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:20.117725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:20.118160 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:20.118890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:20.119345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:20.119770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:20.136488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Getting quotas for project e6eccd42ceef4259b48149c9835fc73b. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:36:20.141583 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Getting quotas for user 42450ebae9bb445dba460ea02832a173 and project e6eccd42ceef4259b48149c9835fc73b. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:36:20.152845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:36:20.155126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:36:20.204069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7b934efc-0b37-4148-abfa-6e50b547ea20 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559644 Sep 28 12:36:20.204712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 535/1061] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:36:20.215675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6eb749f-cfd5-49ee-a172-87fb0f1547d8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:20.216541 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6eb749f-cfd5-49ee-a172-87fb0f1547d8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:20.219697 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:20.220346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:20.278479 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c6eb749f-cfd5-49ee-a172-87fb0f1547d8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:20.285882 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6eb749f-cfd5-49ee-a172-87fb0f1547d8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1219 microversion: 2.1 time: 0.073986 Sep 28 12:36:20.286459 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 527/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:20 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:21.308500 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:21.309107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:21.316391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:21.317117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:21.317586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:21.318295 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:21.318928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:21.319360 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:21.389480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:21.397321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-681455d6-f1c6-4cf0-8d65-fe9aa4bc550e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1289 microversion: 2.1 time: 0.093246 Sep 28 12:36:21.397917 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 536/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:21 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:36:22.422722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:22.423270 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:22.430273 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:22.430751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:22.431178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:22.431864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:22.432309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:22.432726 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:22.563837 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:22.571344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a5b4fd3-405c-4d62-b8c7-0c822aeb555d tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.153298 Sep 28 12:36:22.571921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 528/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:22 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:22.877915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5291f341-17b3-441b-8cd5-007b41955f39", "tag": "0df1578c-0c7a-487b-8ae0-62fe5cd3d302"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:22.888664 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:22.889175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:22.889612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:22.901985 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] Creating event network-changed:0df1578c-0c7a-487b-8ae0-62fe5cd3d302 for instance 5291f341-17b3-441b-8cd5-007b41955f39 on hv-cinder-84456 Sep 28 12:36:22.907085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-9a556cac-80ab-406d-8059-ca4801012ed7 req-5c55e141-2eff-4944-a00f-91201c920e95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034023 Sep 28 12:36:22.907964 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 537/1065] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:36:23.595748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:23.596347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:23.602725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:23.603196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:23.603625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:23.604304 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:23.604775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:23.605230 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:23.730657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:23.738861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-506ab561-04a8-4ab6-b7ac-a5720b3118b5 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.147761 Sep 28 12:36:23.739420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 529/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:23 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:24.762275 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:24.762884 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:24.769621 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:24.770100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:24.770529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:24.771213 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:24.771660 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:24.772077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:24.898559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:24.906931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-eae115a7-2766-480a-a823-506930ad3a66 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.149470 Sep 28 12:36:24.907498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 538/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:24 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:25.929670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:25.930280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:25.936718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:25.937437 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:25.937873 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:25.938564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:25.939023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:25.939441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:26.074614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:26.082935 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-98f68aef-9c0f-4fef-ac49-746767e908bf tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.157181 Sep 28 12:36:26.083507 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 530/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:25 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:27.106090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:27.106693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:27.113258 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:27.113738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:27.114198 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:27.114878 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:27.115326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:27.115744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:27.245156 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:27.253162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6dfeb7bf-483b-4fab-9732-e5167501115f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.150829 Sep 28 12:36:27.253759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 539/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:27 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:28.286385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:28.286987 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:28.293280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:28.293753 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:28.294178 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:28.294860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:28.295306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:28.295721 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:28.424266 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:28.431771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2357bc2d-16bb-4cdf-ad61-87e2902325c8 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.149253 Sep 28 12:36:28.432330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 531/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:28 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:36:29.454478 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:29.455084 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:29.461598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:29.462079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:29.462513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:29.463220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:29.463672 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:29.464090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:29.595062 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:29.603902 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-897f3d68-9b54-4bd0-8c73-98df3f1660fd tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.153309 Sep 28 12:36:29.604472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 540/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:29 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:29.986611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5291f341-17b3-441b-8cd5-007b41955f39", "name": "network-vif-plugged", "status": "completed", "tag": "0df1578c-0c7a-487b-8ae0-62fe5cd3d302"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:29.996006 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:29.996481 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:29.996916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:30.007810 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] Creating event network-vif-plugged:0df1578c-0c7a-487b-8ae0-62fe5cd3d302 for instance 5291f341-17b3-441b-8cd5-007b41955f39 on hv-cinder-84456 Sep 28 12:36:30.012944 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-4b799864-b891-428d-a71e-5c215da46a2a req-a2484885-eb9a-487f-a6c1-d588858ab34e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030389 Sep 28 12:36:30.013565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 532/1072] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:36:30.627547 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:30.628166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:30.630132 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:30.630872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:30.637383 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:30.637872 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:30.638314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:30.639029 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:30.639472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:30.639900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:30.768493 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:30.775947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-190b2fe2-fb62-422a-b8c0-54c2fd8656a7 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.153316 Sep 28 12:36:30.776505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 541/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:30 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:31.795898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:31.801261 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:31.801954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:31.808256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:31.808732 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:31.809188 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:31.809886 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:31.810322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:31.810745 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:31.938389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:31.945885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-64b105e9-f945-4cb0-9b6f-8826b2992e05 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1319 microversion: 2.1 time: 0.150969 Sep 28 12:36:31.946445 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 533/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:31 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:32.969385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:32.970009 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:32.976288 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:32.976763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:32.977234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:32.977914 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:32.978363 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:32.978779 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:33.105259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:33.112933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-be101005-9a7b-42fe-9adc-16d20635e98c tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1508 microversion: 2.1 time: 0.148284 Sep 28 12:36:33.113529 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 542/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:32 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:33.134815 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdbb1977-55fc-4644-8aaa-e95e27ca746a", "device": "/dev/sdb"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:33.137441 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:33.144251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:33.144722 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:33.145169 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:33.145850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:33.146292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:33.146706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:33.394371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c564e35d-ef7c-4329-afa8-27f344c1af46 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "POST /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263237 Sep 28 12:36:33.394969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 534/1076] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:36:33 2022] POST /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:36:54.808708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:54.809216 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:54.811605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:54.812245 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=40 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:54.817903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:54.818382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:54.818864 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:54.819565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:54.820015 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:54.820431 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:54.904408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'services' on Instance uuid 5291f341-17b3-441b-8cd5-007b41955f39 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:36:54.977212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b7ac4150-03a1-444b-a4af-f1bf59f86cec tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39/os-volume_attachments/fdbb1977-55fc-4644-8aaa-e95e27ca746a" status: 202 len: 0 microversion: 2.1 time: 0.172144 Sep 28 12:36:54.977806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 543/1077] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:36:54 2022] DELETE /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39/os-volume_attachments/fdbb1977-55fc-4644-8aaa-e95e27ca746a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:36:56.096899 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:56.097469 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Wed Sep 28 12:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 (ip 10.222.0.60) !!! Sep 28 12:36:56.098166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=18 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:56.098923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:56.103453 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:56.104034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:56.113775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.114189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.114625 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:56.115346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.115795 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.116217 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:56.143581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:36:56.220950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-809ae643-2ec2-419b-afea-f85db91ef860 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 204 len: 0 microversion: 2.1 time: 0.126359 Sep 28 12:36:56.221603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 535/1078] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:36:56 2022] DELETE /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:36:56.230849 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:56.231549 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:56.237910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.238413 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.238825 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:56.239707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.240165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.240591 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:56.375259 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:56.383777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0cf130be-b250-4eca-b86a-b1440b06b6e6 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1514 microversion: 2.1 time: 0.157582 Sep 28 12:36:56.384343 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 544/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:56 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:57.407252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:57.408135 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:57.414510 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:57.414988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:57.415421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:57.416102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:57.416552 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:57.416971 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:57.545531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:57.553186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38eeb56b-2a73-4bc9-97d8-921560a8b0c4 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1514 microversion: 2.1 time: 0.150117 Sep 28 12:36:57.553744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 536/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:57 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:58.576595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:58.577342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:58.583612 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:58.584100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:58.584538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:58.585281 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:58.585742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:58.586170 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:58.788034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:58.796673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-39f87d73-e481-440c-ab93-940f8e8ec26e tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1514 microversion: 2.1 time: 0.223855 Sep 28 12:36:58.799305 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 545/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:58 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:58.954668 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5291f341-17b3-441b-8cd5-007b41955f39", "name": "network-vif-deleted", "tag": "0df1578c-0c7a-487b-8ae0-62fe5cd3d302"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:36:58.964296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:58.964823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:58.965317 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:58.976449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] Creating event network-vif-deleted:0df1578c-0c7a-487b-8ae0-62fe5cd3d302 for instance 5291f341-17b3-441b-8cd5-007b41955f39 on hv-cinder-84456 Sep 28 12:36:58.981099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-fa55d26d-d18e-43bd-8539-cd7af2e0becc req-2f601f2d-517f-4ff4-816d-0f7620314d98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030923 Sep 28 12:36:58.981694 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 537/1082] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:36:59.741105 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:59.741731 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:59.752704 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.753206 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.753777 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.754330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.754780 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.755235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.781188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:36:59.823946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:59.824692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:59.832376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.832866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.833502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.834202 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.834877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.835584 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.863769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a3e25abb-c6c9-4ff7-bfa8-f73883c6cf9a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 204 len: 0 microversion: 2.1 time: 0.126321 Sep 28 12:36:59.864513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 546/1083] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:36:59 2022] DELETE /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:36:59.873225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:59.873443 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.873776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.873925 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:59.874531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.874963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'fault' on Instance uuid 5291f341-17b3-441b-8cd5-007b41955f39 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:36:59.880868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.881537 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.881980 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.882688 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.883148 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.883661 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.915843 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:59.924306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7dcb361e-cb67-4569-b844-4679e7bd1a0a tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1309 microversion: 2.1 time: 0.105902 Sep 28 12:36:59.924880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 538/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:59 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:00.013907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:00.027665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d530b56e-7671-49ed-a628-b82ef24afac5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1577 microversion: 2.1 time: 0.158793 Sep 28 12:37:00.028239 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 547/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:59 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:00.947419 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:00.948402 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:00.955267 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:00.955739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:00.956168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:00.956845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:00.957318 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:00.957737 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:00.988842 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:00.989346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:00.989883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:00.990329 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'fault' on Instance uuid 5291f341-17b3-441b-8cd5-007b41955f39 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:37:01.037963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:01.045458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5c3731a6-61a4-4696-ba55-58fb2d641832 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1309 microversion: 2.1 time: 0.101790 Sep 28 12:37:01.046017 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 539/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:00 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:01.051159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:01.051816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:01.057753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.058232 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.058658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.059351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.059800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.060215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.207668 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:01.215418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a2dc225f-32c2-4882-9329-0a33a2dbe9e0 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1577 microversion: 2.1 time: 0.168332 Sep 28 12:37:01.216247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 548/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:01 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:01.258800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:01.260963 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:01.267505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.267969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.268425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.269108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.269575 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.269991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.297724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2cef1631-05a2-4fc1-acd2-52270170a467 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042821 Sep 28 12:37:01.298264 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 540/1088] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:37:01 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:37:01.362474 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:01.362969 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:01.368881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.369403 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.369844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.370530 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.370987 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.371418 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.396997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:37:01.473898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d9366cbb-863f-45b9-907d-2951caf53700 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 204 len: 0 microversion: 2.1 time: 0.115885 Sep 28 12:37:01.474421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 549/1089] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:37:01 2022] DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:37:01.483381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:01.483974 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:01.491189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.491669 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.492106 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.492954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.493448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.493872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.622105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:01.630533 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c38f84c5-62ed-4f33-969b-dd3d4dc1d5b4 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1672 microversion: 2.1 time: 0.151675 Sep 28 12:37:01.631098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 541/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:01 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:02.070450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:02.071056 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:02.077683 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.078161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.078614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.079307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.079757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.080290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.114894 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.115373 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.115805 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.116249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lazy-loading 'fault' on Instance uuid 5291f341-17b3-441b-8cd5-007b41955f39 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:37:02.163120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42450ebae9bb445dba460ea02832a173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6eccd42ceef4259b48149c9835fc73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:02.172475 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7add289a-105d-4b16-99c3-9a402612201f tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 200 len: 1309 microversion: 2.1 time: 0.106210 Sep 28 12:37:02.173046 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 550/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:02 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:02.239459 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:02.240071 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:02.249868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.250381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.251731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.252606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.253185 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.253619 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.396896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:02.404662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-65352f3b-7b21-491a-8c90-a73349d19538 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1577 microversion: 2.1 time: 0.169758 Sep 28 12:37:02.405250 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 542/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:02 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:02.655919 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:02.656452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:02.663001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.663477 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.663932 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.664636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.665091 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.665548 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.801450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:02.809494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e5afe0d0-08f3-45d4-bea3-83230cd52ae5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1672 microversion: 2.1 time: 0.157566 Sep 28 12:37:02.810070 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 551/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:02 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:03.196132 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:03.196734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] [instance: 5291f341-17b3-441b-8cd5-007b41955f39] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:03.202539 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.203016 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.203444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.204898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.205371 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.205800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.219817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] HTTP exception thrown: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Request method failure captured: Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 HTTP/1.1 Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND90lOp4k5GSA6TfbntatOwtydxd8-wc53FxYaZImc5mfoRCxyZLK2VkNSZMi2CMPYjABbeuY3LXgh2lX93VxcXcJisBSDrmBUsfgrbqjyTZmgFz2_g5wuU7pcjbmnYYI15JOgHQCYbnT5gW-YahqdDsaZahuynBb6LebGldtI-3oNc Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: e6eccd42ceef4259b48149c9835fc73b Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:37:03.221644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6eccd42ceef4259b48149c9835fc73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6eccd42ceef4259b48149c9835fc73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6eccd42ceef4259b48149c9835fc73b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6eccd42ceef4259b48149c9835fc73b"}]}] Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: e6eccd42ceef4259b48149c9835fc73b Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154636101 Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesSnapshotTestJSON-1154636101-project Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 42450ebae9bb445dba460ea02832a173 Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154636101-project Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. Sep 28 12:37:03.223339 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '5291f341-17b3-441b-8cd5-007b41955f39'} Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:37:03.224210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. Sep 28 12:37:03.225657 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:03.226852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] Returning 404 to user: Instance 5291f341-17b3-441b-8cd5-007b41955f39 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:37:03.226852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cb158b2-6251-4dca-aa4f-5b0d14627618 tempest-VolumesSnapshotTestJSON-1154636101 tempest-VolumesSnapshotTestJSON-1154636101-project] 10.222.0.60 "GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39" status: 404 len: 111 microversion: 2.1 time: 0.030703 Sep 28 12:37:03.226852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 543/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:03 2022] GET /compute/v2.1/servers/5291f341-17b3-441b-8cd5-007b41955f39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:37:03.429933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:03.431141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:03.447229 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.448692 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.450017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.451539 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.452900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.454538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.687648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:03.700344 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4d35189d-2169-4254-aac8-50fce7e0dcc1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1509 microversion: 2.1 time: 0.275530 Sep 28 12:37:03.701345 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 552/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:03 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:03.833380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:03.835084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:03.848442 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.849363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.851679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.853047 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.853747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.856725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.896963 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de20408b-1f47-488b-976f-f41706a8509f", "name": "network-vif-deleted", "tag": "0db4c4f8-4e18-4c3f-afdd-33f13f47b330"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:03.915961 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.916472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.916898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.945166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] Creating event network-vif-deleted:0db4c4f8-4e18-4c3f-afdd-33f13f47b330 for instance de20408b-1f47-488b-976f-f41706a8509f on hv-cinder-84456 Sep 28 12:37:03.953762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-a8fcb6ac-9074-4398-a9d9-b2f0ff0bf477 req-7add204f-f45c-4db0-842b-ff8eeca0d7f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060213 Sep 28 12:37:03.954386 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 553/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:37:04.124871 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:04.133207 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f9da70e0-10d2-47a0-8b19-d6a5e045b838 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1672 microversion: 2.1 time: 0.303612 Sep 28 12:37:04.133782 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 544/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:03 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1672 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:04.540786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54de1c40-5bbc-4c85-a7e2-339655ec6716", "name": "network-vif-deleted", "tag": "429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:04.557495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.558320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.571106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.596410 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] Creating event network-vif-deleted:429c43f1-2aa1-4c2c-b2d1-6c765b5ff7e0 for instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 on hv-cinder-84456 Sep 28 12:37:04.601818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-15ba1e98-56b1-4db4-a8a2-8370673cc2f6 req-d3051ba7-47b5-442b-96f8-2c7342e52b5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066889 Sep 28 12:37:04.603325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 554/1098] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:04.729396 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:04.730279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:04.743491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.747772 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.748287 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.751598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.753363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.753883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.797977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.798953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.799561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.800172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lazy-loading 'fault' on Instance uuid de20408b-1f47-488b-976f-f41706a8509f {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:37:04.864471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:04.875018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-55f7db92-c372-41bc-a672-4c9f0dadbfd7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 200 len: 1231 microversion: 2.1 time: 0.152086 Sep 28 12:37:04.876616 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 545/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:04 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 1231 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:05.159061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:05.159766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:05.177408 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.177923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.178382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.181759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.182582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.183158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.222471 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.223234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.223670 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.224120 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lazy-loading 'fault' on Instance uuid 54de1c40-5bbc-4c85-a7e2-339655ec6716 {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:37:05.268773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:05.276764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-11f013be-a820-40ff-8fc6-d99f0d926ffb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 200 len: 1327 microversion: 2.1 time: 0.124092 Sep 28 12:37:05.277665 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 555/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:05 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:05.898759 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:05.899325 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:05.905720 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.906191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.906624 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.907307 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.907748 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.908168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.921784 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] HTTP exception thrown: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Request method failure captured: Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f HTTP/1.1 Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND8bTXKNWF6IWfkeBJZ9XJznGKn9rnqr9NODBkflTQQGZw7oE85IzlT6EaIpyinl6iTjFp2Vx6Rhv3EkLe033mniqlj1BC2cwvwC-QFta5buyPnZFkVYCAP-iIFYiEF9ND7B0eJjq1Jwpk1CQwQoPhZVOFuhuHqDHK1NjMKeW6R7G5w Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:37:05.923828 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d73c25391e8044c2ac3678317021732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d73c25391e8044c2ac3678317021732d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}] Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 5b723fcdba1d4b26bd0cf604d59f8d8c Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:37:05.925496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'de20408b-1f47-488b-976f-f41706a8509f'} Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:37:05.926478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:37:05.928024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:05.929513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Returning 404 to user: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:37:05.929513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85d0bc4d-57b9-498b-8175-ee8d2cdb37ee tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 404 len: 111 microversion: 2.1 time: 0.030399 Sep 28 12:37:05.929513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 546/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:05 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:37:06.022243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-492509281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1668387227", "security_groups": [{"name": "tempest-secgroup-smoke-1396524423"}], "block_device_mapping_v2": [{"uuid": "cccad23b-d542-410c-b63c-9c493e3427fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf8da1f-c122-40d9-8bf4-a166b5233ca8"}]}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:06.147943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] validate_networks() for [('cbf8da1f-c122-40d9-8bf4-a166b5233ca8', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:37:06.301009 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:06.301659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:06.307686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.308165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.308601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.309314 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.309770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.310195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.325040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 HTTP/1.1 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:37:06.326659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:37:06.328305 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '54de1c40-5bbc-4c85-a7e2-339655ec6716'} Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:37:06.330040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:37:06.331327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:37:06.332492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:37:06.332492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f68da7e6-68e1-4785-b8da-834f70c3a5f6 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 404 len: 111 microversion: 2.1 time: 0.031550 Sep 28 12:37:06.332492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 547/1102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:06 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:37:06.337818 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-13ddfe8b-321f-4718-b2ee-80c2d79c84b0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '.version_select at 0x7fa7069ff040>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:06.359428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-13ddfe8b-321f-4718-b2ee-80c2d79c84b0 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992874332" status: 202 len: 0 microversion: 2.1 time: 0.025113 Sep 28 12:37:06.360431 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 548/1103] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 12:37:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992874332 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:37:06.518601 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:37:06.519020 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:37:06.519487 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:37:06.519886 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:37:06.520451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:37:06.529690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.530191 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.530618 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.531331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.532276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.532852 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.539936 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:06.554515 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:37:06.558822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for user 5b723fcdba1d4b26bd0cf604d59f8d8c and project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:37:06.618681 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:37:06.620824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cccad23b-d542-410c-b63c-9c493e3427fa',volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:37:06.760979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-019ed2b6-da84-40e1-8a5e-b43c9f561c70 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742550 Sep 28 12:37:06.761784 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 556/1104] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:37:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:37:06.773364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-92a1b6de-7325-4111-bd45-8181081db308 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:06.774224 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-92a1b6de-7325-4111-bd45-8181081db308 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:06.864253 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-92a1b6de-7325-4111-bd45-8181081db308 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:06.873605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-92a1b6de-7325-4111-bd45-8181081db308 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1094 microversion: 2.1 time: 0.104018 Sep 28 12:37:06.874360 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 549/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:06 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:07.291187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b05d8e33-a8d2-461d-b468-6a2846c83472 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: .version_select at 0x7fa706c93e50>, body: {"keypair": {"name": "tempest-keypair-949925897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHIfyXnZPM1mlAehX1R9xVuNqcjcXbuolRZR2o2fEnM+8w6ZlYbPkN+8inJKFxvNnDS96m+0mqdha40F5MJvcVkadOXeowAU72P76Tn6bud1ekmdnIKfgo2ZxCUNInT/A=="}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:07.307054 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b05d8e33-a8d2-461d-b468-6a2846c83472 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:37:07.310851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-b05d8e33-a8d2-461d-b468-6a2846c83472 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for user 1885a2c4c42b47cb892b097557575642 and project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'key_pairs'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:37:07.333318 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b05d8e33-a8d2-461d-b468-6a2846c83472 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046398 Sep 28 12:37:07.333908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 557/1106] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 12:37:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:07.896085 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:07.896771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:07.903352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:07.903865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:07.904309 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:07.905025 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:07.905531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:07.905958 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:07.968519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:07.976885 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7f4dd5b0-abce-4ce3-aaf8-a41f49796392 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1144 microversion: 2.1 time: 0.084674 Sep 28 12:37:07.977484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 550/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:07 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:08.550110 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1441550292", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39f4ee97-5c8b-4b12-ab00-ecff529a7cc2"}], "security_groups": [{"name": "tempest-securitygroup--195499251"}], "key_name": "tempest-keypair-949925897", "user_data": "}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:08.650014 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] validate_networks() for [('39f4ee97-5c8b-4b12-ab00-ecff529a7cc2', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:37:09.000154 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:09.002005 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:09.008667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.009187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.009603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.010301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.010745 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.011164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.033209 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:37:09.033634 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:37:09.034107 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:37:09.034511 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:37:09.034922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:37:09.043445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.043923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.044357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.045083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.045570 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.045991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.064250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:37:09.068018 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Getting quotas for user 1885a2c4c42b47cb892b097557575642 and project 77a0da6cfbd9415cbff856f9cfffee97. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:37:09.077509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:09.080248 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:37:09.083117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:37:09.086756 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0f222937-de7b-49d2-b55e-122d9c9e8a0f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1192 microversion: 2.1 time: 0.089429 Sep 28 12:37:09.087338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 551/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:08 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:09.138535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-df6cde82-acd3-412c-9bf4-72c801d75dec tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593750 Sep 28 12:37:09.139341 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 558/1109] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:37:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:37:09.150343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc002df2-5259-4c34-946c-4cdc5a94b718 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:09.150955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dc002df2-5259-4c34-946c-4cdc5a94b718 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:09.242214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dc002df2-5259-4c34-946c-4cdc5a94b718 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:09.253659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dc002df2-5259-4c34-946c-4cdc5a94b718 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1237 microversion: 2.1 time: 0.102825 Sep 28 12:37:09.254269 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 552/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:09 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:10.112133 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:10.112745 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:10.118949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.119427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.119861 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.120541 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.120992 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.121435 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.276279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:10.276760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:10.277020 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:10.287749 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2158d304-394a-452c-993f-925c0ef924c4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1278 microversion: 2.1 time: 0.179526 Sep 28 12:37:10.291200 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.293708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.294238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.295685 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.296369 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.297057 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.305234 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 559/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:10 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:10.403919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:10.419503 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7df6eb1f-30fc-4e2e-94f2-e8b942b8f659 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1289 microversion: 2.1 time: 0.147343 Sep 28 12:37:10.423217 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 553/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:10 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:11.103518 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9459b4-bb4a-4835-bcc2-8103c94e6149", "tag": "c1437638-56f9-420a-bb35-7051efebc13d"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:11.114083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.114750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.114976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.127768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] Creating event network-changed:c1437638-56f9-420a-bb35-7051efebc13d for instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 on hv-cinder-84456 Sep 28 12:37:11.133078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-886a3778-fda0-4ee6-9c37-fa19f47d878b req-0dd9ea85-7af3-47f8-b8fc-158aeb2130eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033125 Sep 28 12:37:11.133653 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 560/1113] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:11.312380 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:11.314585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:11.321091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.321615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.322049 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.322744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.323194 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.323614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.342532 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:11.446614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:11.447449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:11.454602 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.455094 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.455563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.456285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.456915 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.457497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.529809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:11.541499 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0f7ea20f-c0dd-4ab2-b3dc-b74c8bfcf42c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1295 microversion: 2.1 time: 0.099294 Sep 28 12:37:11.542750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 561/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:11 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:11.550508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:11.559903 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-613344ce-3b5d-4fb2-915b-fd90ed9f983a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.251290 Sep 28 12:37:11.561877 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 554/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:11 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:12.394215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d49cd76-a03a-4226-ba7a-114f6349921c", "tag": "2ac4cfa4-21c1-4644-978c-9becf43a9cfc"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:12.403908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.404387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.404807 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.417008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] Creating event network-changed:2ac4cfa4-21c1-4644-978c-9becf43a9cfc for instance 4d49cd76-a03a-4226-ba7a-114f6349921c on hv-cinder-84456 Sep 28 12:37:12.421826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-0158c420-ebe1-434b-bb04-8d3e115e868c req-93683973-8773-4d0b-a104-f550bbc5f2b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031304 Sep 28 12:37:12.423002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 562/1116] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:12.566061 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:12.566693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:12.572970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.573487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.573923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.574604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.575086 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.575508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.584540 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:12.585378 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:12.588329 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:12.592598 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.593081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.593532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.594750 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.595199 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.595617 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.706579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:12.714290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f9dea4a9-cccf-4e5f-9df8-f7809afd3c76 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.152250 Sep 28 12:37:12.714857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 555/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:12 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:12.747238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:12.754933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-77d8e0dc-ff10-44b6-b53f-a62ac78525c2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.174496 Sep 28 12:37:12.755508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 563/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:12 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:13.738992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:13.739611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:13.746084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.746493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.746917 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.747602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.748046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.748466 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.778799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:13.779912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:13.789607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.790348 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.791004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.792071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.792906 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.793495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.885564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:13.894216 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a4f9f66e-9d25-4e07-a91e-3839a81544dc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.159025 Sep 28 12:37:13.894790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 556/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:13 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:13.928117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:13.935865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-37d26d14-7650-46a2-9fa9-4bce394088b8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.161610 Sep 28 12:37:13.936432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 564/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:13 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:14.917667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:14.918191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:14.924606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.925078 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.925530 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:14.926205 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.926649 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.927074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:14.959155 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:14.959769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:14.966802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.967538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.968078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:14.969806 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.970316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.970741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:15.056604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:15.064542 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c54bcbb-fdb3-41d5-8dd0-4204c7b4ced3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.150728 Sep 28 12:37:15.065108 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 557/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:14 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:15.107737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:15.115510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-421b2224-41ff-490a-9ee1-d082727a649c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.160179 Sep 28 12:37:15.116081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 565/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:14 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:16.087946 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:16.088551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:16.095636 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.096103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.096535 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.097332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.097776 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.098192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.137261 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:16.137986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:16.144658 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.145161 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.145611 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.146307 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.146762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.147183 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.228457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:16.236762 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-93f189ee-114a-416f-a418-8a0c786431bb tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.152691 Sep 28 12:37:16.237463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 558/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:16 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:16.277533 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:16.285122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9def6f22-8eee-469d-b5bb-ac166054002c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.151714 Sep 28 12:37:16.285695 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 566/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:16 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:17.260834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:17.261472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:17.268559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.269048 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.269518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.270212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.270670 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.271098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.307856 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:17.308572 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:17.316178 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.316762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.317302 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.318002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.318491 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.318911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.400780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:17.409627 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-930e8522-06a4-4553-8ab6-e6f8a344b88a tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.152459 Sep 28 12:37:17.410132 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 559/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:17 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:17.450903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:17.459300 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4fda057d-a45e-48ab-a8cd-6357ca110f4c tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.155346 Sep 28 12:37:17.459859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 567/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:17 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:18.433064 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:18.433708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:18.440972 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.441480 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.441915 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.442598 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.443046 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.443472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.484046 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:18.484854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:18.492061 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.492543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.492982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.493724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.494192 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.494613 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.585868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:18.595743 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d8e0d74f-6ce6-436b-9a8b-418bb0884988 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.166430 Sep 28 12:37:18.596641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 560/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:18 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:18.635568 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:18.643907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-89cc78e4-2b7f-42a9-9830-c4333027d4a4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.165689 Sep 28 12:37:18.644693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 568/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:18 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:19.619822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:19.620430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:19.622280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:19.628397 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.628880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.629353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.630040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.630491 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.630916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.667047 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:19.667656 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:19.670581 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=4 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:19.671332 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=16 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:19.677462 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.677954 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.678390 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.679099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.679551 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.679976 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.762330 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:19.770173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fca38cf5-fee7-41ba-a585-32c1261a5694 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.154202 Sep 28 12:37:19.770975 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 561/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:19 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:19.807508 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:19.815201 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b6c7c7f0-63dc-4c36-be4e-024b79ab0fdc tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.151990 Sep 28 12:37:19.815764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 569/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:19 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:20.793744 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:20.794276 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:20.801138 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.801635 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.802072 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.802760 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.803214 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.803639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.838025 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:20.838975 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:20.846235 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.846848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.847351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.848065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.848519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.849034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.943110 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:20.951439 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e3f38bc-aeb7-4c28-b83a-3efd21783e42 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.161591 Sep 28 12:37:20.952075 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 562/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:20 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:20.992990 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:21.001449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-0795416e-5b83-4fff-92fd-1fdf454ca2ca tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.167125 Sep 28 12:37:21.002031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 570/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:20 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:21.977788 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:21.978395 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:21.984926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.985474 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.985911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:21.986765 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.987463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.988115 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:22.023713 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:22.024451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:22.031314 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:22.031843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:22.032283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:22.032989 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:22.033481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:22.033907 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:22.115962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:22.123712 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea3b2cde-cef9-439b-bccf-e2df0433cbb3 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.149737 Sep 28 12:37:22.124377 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 563/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:21 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:22.163476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:22.171290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-7d270fee-3562-4b14-b140-7f96276aee76 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.151346 Sep 28 12:37:22.171855 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 571/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:22 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:23.073447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d49cd76-a03a-4226-ba7a-114f6349921c", "name": "network-vif-plugged", "status": "completed", "tag": "2ac4cfa4-21c1-4644-978c-9becf43a9cfc"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:23.083910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.084392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.084817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.096493 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] Creating event network-vif-plugged:2ac4cfa4-21c1-4644-978c-9becf43a9cfc for instance 4d49cd76-a03a-4226-ba7a-114f6349921c on hv-cinder-84456 Sep 28 12:37:23.101774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dab54a89-bd69-4ca6-a578-01399a05ed0e req-bf4f31f3-df45-44ba-897d-43148033ff5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 Sep 28 12:37:23.102383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 564/1135] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:23.149078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:23.149732 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:23.157615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.158370 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.158809 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.160100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.160928 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.161400 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.194846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:23.195948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:23.202534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.203644 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.204301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.205257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.205931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.206564 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.332862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:23.340912 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ee62f4c0-7fca-4191-a899-7eedf9005c27 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.196494 Sep 28 12:37:23.341759 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 572/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:23 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:23.400150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:23.409385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5423e263-baa4-4b8c-bac1-e995e87bd412 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.218590 Sep 28 12:37:23.410050 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 565/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:23 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:24.364449 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:24.365051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:24.371424 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.371901 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.372330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.373010 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.373492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.373910 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.432617 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:24.433256 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:24.440534 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.441023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.441488 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.442184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.442643 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.443067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.506761 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:24.519397 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-78d82ec5-1e13-484f-80b1-f2713b995e0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1362 microversion: 2.1 time: 0.158681 Sep 28 12:37:24.520276 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 573/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:24 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:24.584338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:24.592630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b35717a5-7352-4478-b029-acf4f4c9c996 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.163885 Sep 28 12:37:24.593224 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 566/1139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:24 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:25.242358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9459b4-bb4a-4835-bcc2-8103c94e6149", "name": "network-vif-plugged", "status": "completed", "tag": "c1437638-56f9-420a-bb35-7051efebc13d"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:25.252049 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.252519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.252971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.263514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] Creating event network-vif-plugged:c1437638-56f9-420a-bb35-7051efebc13d for instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 on hv-cinder-84456 Sep 28 12:37:25.269011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-eb910d14-2ae3-4ebf-ae3d-f8b59445d145 req-bb4da273-6853-499a-b494-8bf2a6a6e09b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030305 Sep 28 12:37:25.269676 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 574/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:25.545013 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:25.545701 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:25.552604 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.553083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.553581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.554265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.554714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.555133 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.617463 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:25.622371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:25.641331 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.641972 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.642970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.643347 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.643880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.644399 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.746505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:25.759735 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c165654-c428-4b42-b175-1d85fbaad125 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1547 microversion: 2.1 time: 0.218404 Sep 28 12:37:25.761118 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 567/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:25 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:25.785227 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:25.786132 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:25.793246 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.793734 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.794172 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.794861 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.795367 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.796244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.798657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:25.806996 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-dcf4393c-c9c0-45f4-850d-db9480495122 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.194302 Sep 28 12:37:25.807579 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 575/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:25 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:25.883497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-40b73eb4-cb68-4830-aa5a-6d9a4fbff4a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102858 Sep 28 12:37:25.884336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 568/1143] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 12:37:25 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:37:26.831494 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:26.832045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:26.838285 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:26.838762 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:26.839190 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:26.839873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:26.840325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:26.840991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:26.976900 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:26.985224 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-29c8a733-7a10-4eff-9065-08f4789f1bd1 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1266 microversion: 2.1 time: 0.158510 Sep 28 12:37:26.985803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 576/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:26 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:27.054392 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d49cd76-a03a-4226-ba7a-114f6349921c", "tag": "2ac4cfa4-21c1-4644-978c-9becf43a9cfc"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:27.063091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:27.065320 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:27.065739 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:27.066160 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:27.078992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] Creating event network-changed:2ac4cfa4-21c1-4644-978c-9becf43a9cfc for instance 4d49cd76-a03a-4226-ba7a-114f6349921c on hv-cinder-84456 Sep 28 12:37:27.084384 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-6dd60a2f-be45-41fe-b3e9-83c84f88a1ec req-15ca9593-94ed-4d67-8b4e-2793c13e3f15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 Sep 28 12:37:27.095736 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 569/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:37:28.007984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:28.008873 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:28.016407 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:28.016898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:28.017392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:28.018101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:28.018723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:28.019142 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:28.023677 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=100 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:28.164151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:28.178480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-aa590742-2432-4660-a906-6f5064415830 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1452 microversion: 2.1 time: 0.174243 Sep 28 12:37:28.179758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 577/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:28 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:28.203991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:28.204679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:28.211119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:28.212231 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:28.212675 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:28.213430 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:28.213883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:28.214301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:28.417823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:28.426638 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a9e3e7a3-718a-452c-86e6-49b4396ab4bf tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1452 microversion: 2.1 time: 0.227470 Sep 28 12:37:28.427215 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 570/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:28 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:30.092843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9459b4-bb4a-4835-bcc2-8103c94e6149", "tag": "c1437638-56f9-420a-bb35-7051efebc13d"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:30.102799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:30.104309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:30.104309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:30.115202 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] Creating event network-changed:c1437638-56f9-420a-bb35-7051efebc13d for instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 on hv-cinder-84456 Sep 28 12:37:30.120038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-0adaa14d-7a2b-4538-a007-2ac1d9f5e533 req-29406099-8f98-4d8a-8714-2d94075ffe17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Sep 28 12:37:30.120628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 578/1148] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:38:42.044173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:42.045082 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=88 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:42.046239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:38:42.046406 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Wed Sep 28 12:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/ips (ip 10.222.0.60) !!! Sep 28 12:38:42.051289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:42.051832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:42.059551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:42.060029 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:42.060463 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:42.061164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:42.061622 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:42.062045 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:42.086131 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9de5db26-b21c-449e-acd9-bec096ccfdd8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/ips" status: 200 len: 144 microversion: 2.1 time: 0.043848 Sep 28 12:38:42.086696 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 571/1149] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:38:42 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:38:43.417605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=30 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:43.418342 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:43.423263 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a767b583-0307-4d42-a994-9ed6d269a041"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:38:43.425626 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:43.432748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:43.433267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:43.433708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:43.434401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:43.434859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:43.435289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:43.886697 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5ccfb66d-5849-47c3-bf2a-2a303c470212 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471112 Sep 28 12:38:43.887294 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 579/1150] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:38:43 2022] POST /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:38:51.421725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:51.423822 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:51.430874 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.431352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.431787 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.432472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.432922 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.433377 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.462487 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-babdb974-ee41-47f4-b3b3-fd4ac21554b8 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Sep 28 12:38:51.463033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 572/1151] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:38:51 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:38:51.475387 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:51.476051 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:51.482501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.482991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.483432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.484126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.484585 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.485011 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.514744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-c2d73415-3244-4dfa-b04a-a7b29e61cfca tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041" status: 200 len: 194 microversion: 2.1 time: 0.044512 Sep 28 12:38:51.515321 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 580/1152] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 12:38:51 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:38:52.842097 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c816ed7-abad-4ac5-acc6-c26e3504d6dd"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:38:52.844420 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:52.851370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:52.851850 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:52.852282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:52.852966 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:52.853451 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:52.853873 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:53.186921 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dbc4408b-bede-4633-b27e-6e28160622a2 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "POST /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348745 Sep 28 12:38:53.187531 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 573/1153] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 12:38:52 2022] POST /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:00.735489 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:00.737772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:00.748931 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.749482 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.749921 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.750629 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.751080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.751499 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.782117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a63ef65d-26cc-45dc-8680-0bbaa4485ffc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050631 Sep 28 12:39:00.782680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 581/1154] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:39:00 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:00.929114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:00.929692 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:00.935997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.936473 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.936910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.937631 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.938081 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.938498 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.967778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d8a6d43-b917-4c8e-99b8-e5a1b0be56e5 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041" status: 200 len: 194 microversion: 2.1 time: 0.043754 Sep 28 12:39:00.968346 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 574/1155] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 12:39:00 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:00.979354 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:00.979854 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:00.985769 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.986244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.986673 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.987350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.987796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.988213 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:01.068590 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lazy-loading 'services' on Instance uuid 4d49cd76-a03a-4226-ba7a-114f6349921c {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:39:01.142763 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6964199b-cc6c-4e33-aafb-a63bafc66529 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041" status: 202 len: 0 microversion: 2.1 time: 0.167658 Sep 28 12:39:01.143353 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 582/1156] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:39:00 2022] DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/a767b583-0307-4d42-a994-9ed6d269a041 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:03.323492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:03.324032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:03.330363 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.330845 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.331277 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.331959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.332411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.332831 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.361327 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c8b53a28-c339-436d-baeb-97b052ba094e tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/6c816ed7-abad-4ac5-acc6-c26e3504d6dd" status: 200 len: 194 microversion: 2.1 time: 0.041680 Sep 28 12:39:03.361896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 575/1157] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 12:39:03 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/6c816ed7-abad-4ac5-acc6-c26e3504d6dd => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:03.374008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:03.374582 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:03.380986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.381492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.381924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.382609 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.383090 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.383512 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.463528 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.objects.instance [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lazy-loading 'services' on Instance uuid 4d49cd76-a03a-4226-ba7a-114f6349921c {{(pid=120393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:39:03.537287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-10def3d1-4d49-450b-9e2d-fca489a47145 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/6c816ed7-abad-4ac5-acc6-c26e3504d6dd" status: 202 len: 0 microversion: 2.1 time: 0.167831 Sep 28 12:39:03.537862 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 583/1158] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 12:39:03 2022] DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments/6c816ed7-abad-4ac5-acc6-c26e3504d6dd => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:04.710560 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:04.712793 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:04.719341 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.719816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.720252 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.720932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.721444 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.721867 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.751087 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3fb2b477-bda9-4539-900f-6fe3315bbf0d tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044494 Sep 28 12:39:04.751633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 576/1159] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:39:04 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:39:04.869304 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:04.871643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:04.877729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.878217 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.878657 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.879430 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.879885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.880309 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.908320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6268af07-f74f-4590-b96f-a89383d37eb7 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044405 Sep 28 12:39:04.908868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 584/1160] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 12:39:04 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:39:04.974623 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:04.975186 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:04.981648 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.982114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.982543 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.983219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.983661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.984074 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:05.008027 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:39:05.085261 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-95686798-cd90-4dfb-af69-0b2186002b77 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 204 len: 0 microversion: 2.1 time: 0.114746 Sep 28 12:39:05.085846 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 577/1161] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:39:04 2022] DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:39:05.094885 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:05.095513 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:05.101897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:05.102394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:05.102817 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:05.103506 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:05.103959 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:05.104382 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:05.234693 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:05.242412 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a942b167-9dd6-46d8-b9c4-f936b47dc6ea tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1671 microversion: 2.1 time: 0.151517 Sep 28 12:39:05.242971 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 585/1162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:05 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:39:06.267209 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:06.267914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:06.274948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:06.275465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:06.275898 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:06.276700 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:06.277184 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:06.277611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:06.403602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:06.411766 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-44bd1c90-4e19-4dae-bece-62999ad2c60c tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1671 microversion: 2.1 time: 0.148933 Sep 28 12:39:06.412336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 578/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:06 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:07.436374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:07.436983 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:07.443466 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:07.443947 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:07.444385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:07.445079 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:07.445562 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:07.445994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:07.577273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885a2c4c42b47cb892b097557575642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a0da6cfbd9415cbff856f9cfffee97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:07.585919 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-26c5b985-57ad-42c5-a538-2123f4c21afc tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 200 len: 1671 microversion: 2.1 time: 0.153290 Sep 28 12:39:07.586884 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 586/1164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:07 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:07.970338 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d49cd76-a03a-4226-ba7a-114f6349921c", "name": "network-vif-deleted", "tag": "2ac4cfa4-21c1-4644-978c-9becf43a9cfc"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:39:07.982417 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:07.982884 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:07.983301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:07.996212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] Creating event network-vif-deleted:2ac4cfa4-21c1-4644-978c-9becf43a9cfc for instance 4d49cd76-a03a-4226-ba7a-114f6349921c on hv-cinder-84456 Sep 28 12:39:08.001457 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-d1d64955-717a-420d-b190-4083190f7854 req-8d07ac4a-873d-4d7c-bffc-c2d744aafbcc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036332 Sep 28 12:39:08.002044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 579/1165] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:08.612417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:08.613067 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:08.621113 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:08.621707 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:08.622127 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:08.622828 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:08.623278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:08.623698 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:08.638450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c HTTP/1.1 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:39:08.640146 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:08.641938 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '4d49cd76-a03a-4226-ba7a-114f6349921c'} Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:08.643252 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:08.644834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:08.646597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:08.646597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2a9046f3-e240-482b-810d-66b1fe87b3d1 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 404 len: 111 microversion: 2.1 time: 0.033259 Sep 28 12:39:08.646597 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 587/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:08 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:08.651170 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e68116b7-4d9d-43df-8739-bd719bc50d31 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '.version_select at 0x7fa7084ad670>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:08.670883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e68116b7-4d9d-43df-8739-bd719bc50d31 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949925897" status: 202 len: 0 microversion: 2.1 time: 0.024024 Sep 28 12:39:08.671465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 580/1167] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 12:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949925897 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:11.631278 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:11.631768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:11.638325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:11.638793 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:11.639220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:11.639904 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:11.640355 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:11.640776 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:11.654473 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c HTTP/1.1 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:39:11.656017 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.657767 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '4d49cd76-a03a-4226-ba7a-114f6349921c'} Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:11.658633 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.659966 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.661326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:11.661326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ba350910-cee6-410e-8852-24a28adae475 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 404 len: 111 microversion: 2.1 time: 0.030040 Sep 28 12:39:11.661326 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 588/1168] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:39:11 2022] DELETE /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:11.666904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:11.667633 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 4d49cd76-a03a-4226-ba7a-114f6349921c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:11.674123 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:11.674601 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:11.675040 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:11.675723 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:11.676173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:11.676595 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:11.689348 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c HTTP/1.1 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:39:11.690930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.692747 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '4d49cd76-a03a-4226-ba7a-114f6349921c'} Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:11.693816 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. Sep 28 12:39:11.695218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:11.696477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 4d49cd76-a03a-4226-ba7a-114f6349921c could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:11.696477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-abec839f-588a-49e9-b321-695e01df2708 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c" status: 404 len: 111 microversion: 2.1 time: 0.030475 Sep 28 12:39:11.696477 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 581/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:11 2022] GET /compute/v2.1/servers/4d49cd76-a03a-4226-ba7a-114f6349921c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:12.830760 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:12.831273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:12.837742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.838225 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.838662 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.839352 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.840059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.840483 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.853991 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 HTTP/1.1 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:39:12.855519 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.857188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '54de1c40-5bbc-4c85-a7e2-339655ec6716'} Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:12.858122 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.859640 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.861187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:12.861187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-995dcd9e-9f5c-4079-98da-c61277495e69 tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 404 len: 111 microversion: 2.1 time: 0.030073 Sep 28 12:39:12.861187 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 589/1170] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:39:12 2022] DELETE /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:12.866799 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:12.867410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] [instance: 54de1c40-5bbc-4c85-a7e2-339655ec6716] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:12.869809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:12.875289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.875770 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.876203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.876896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.877370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.877794 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.881191 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:12.894226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] HTTP exception thrown: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Request method failure captured: Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 HTTP/1.1 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND6kXxwtNJG0yzrLiDt3QO037xOFPRwgpujA5wXR9axScA6eYT5zGIJzj5gTu6fgFzsGdraupOZS5536lmeIt6rvC5H1i1l0aIqAmCIH_YfYJ3pDYS1L1f_o_qxkVb8Bj02H5lcmk1dOXiGLwleFVw8ttVMVXe9SVDGsWK7USyU_9mA Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:39:12.895755 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77a0da6cfbd9415cbff856f9cfffee97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77a0da6cfbd9415cbff856f9cfffee97", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77a0da6cfbd9415cbff856f9cfffee97"}]}] Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 77a0da6cfbd9415cbff856f9cfffee97 Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546673424 Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 1885a2c4c42b47cb892b097557575642 Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1546673424-project Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.897568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '54de1c40-5bbc-4c85-a7e2-339655ec6716'} Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:12.898671 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. Sep 28 12:39:12.900232 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:12.901682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] Returning 404 to user: Instance 54de1c40-5bbc-4c85-a7e2-339655ec6716 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:12.901682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-834f01ed-c647-47c6-ac4b-ee88632cdbbe tempest-AttachVolumeTestJSON-1546673424 tempest-AttachVolumeTestJSON-1546673424-project] 10.222.0.60 "GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716" status: 404 len: 111 microversion: 2.1 time: 0.035529 Sep 28 12:39:12.901682 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 582/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:12 2022] GET /compute/v2.1/servers/54de1c40-5bbc-4c85-a7e2-339655ec6716 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:17.174766 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6321c105-2d11-41c6-b45c-bc4c9ecf7178 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Action: 'create', calling method: .version_select at 0x7fa706d94a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1675094890"}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:39:17.457176 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6321c105-2d11-41c6-b45c-bc4c9ecf7178 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.393424 Sep 28 12:39:17.457897 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 590/1172] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Sep 28 12:39:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 395 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 12:39:17.471124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6ad9f612-f679-49fc-8964-ea89af218336 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706b268b0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:17.525997 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6ad9f612-f679-49fc-8964-ea89af218336 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 200 len: 345 microversion: 2.1 time: 0.058658 Sep 28 12:39:17.526561 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 583/1173] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:39:17 2022] GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:39:18.541716 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-985eb08e-3f80-446a-aa3b-aa1717f8534f tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706da18b0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:18.588691 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-985eb08e-3f80-446a-aa3b-aa1717f8534f tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 200 len: 346 microversion: 2.1 time: 0.051831 Sep 28 12:39:18.589267 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 591/1174] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:39:18 2022] GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:18.603602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a03534b1-c720-41a0-9207-044a322811e4 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Action: 'create', calling method: .version_select at 0x7fa706a30a60>, body: {"snapshot": {"volume_id": "87bbbb71-7da2-4f43-aa5e-fe84bfc545c1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1742287032"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:39:18.757754 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a03534b1-c720-41a0-9207-044a322811e4 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.159028 Sep 28 12:39:18.758335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 584/1175] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Sep 28 12:39:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:18.769605 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-88ce26ea-00dc-4ac1-bd5f-87af57d4eb95 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706cc8550>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:18.801420 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-88ce26ea-00dc-4ac1-bd5f-87af57d4eb95 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.035657 Sep 28 12:39:18.807648 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 592/1176] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:18 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:18.812812 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-964492c4-cea8-4cd2-8744-7ddf0cd2abbc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706a308b0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:18.844520 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-964492c4-cea8-4cd2-8744-7ddf0cd2abbc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035323 Sep 28 12:39:18.845097 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 585/1177] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 28 12:39:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:18.856221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-70ec40c4-137a-4b74-99f9-838a2fe0efa1 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706d94ca0>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:18.890848 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-70ec40c4-137a-4b74-99f9-838a2fe0efa1 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.038141 Sep 28 12:39:18.892032 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 593/1178] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:18 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:19.905476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cab63ecb-05ae-4859-ace2-9441d6944de1 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa7069ff670>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:19.935399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cab63ecb-05ae-4859-ace2-9441d6944de1 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.034193 Sep 28 12:39:19.935951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 586/1179] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:19 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:20.949316 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-488bbdd8-404a-4cf6-aae2-d17b00067540 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706e80790>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:20.979615 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-488bbdd8-404a-4cf6-aae2-d17b00067540 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.034201 Sep 28 12:39:20.980290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 594/1180] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:20 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:21.993362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a3ce37af-5ef9-4b44-a9c8-d4ea01fb11f7 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706a2e280>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:22.023447 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a3ce37af-5ef9-4b44-a9c8-d4ea01fb11f7 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.034730 Sep 28 12:39:22.024002 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 587/1181] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:21 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:23.033644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=22 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:23.034381 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:23.038891 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-83e33fef-2aa1-4e6c-8cd4-ccc00a1e6091 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa707077430>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:23.068705 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-83e33fef-2aa1-4e6c-8cd4-ccc00a1e6091 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 288 microversion: 2.1 time: 0.036396 Sep 28 12:39:23.069290 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 595/1182] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:23 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:23.077275 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:23.081880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2153b4e7-0f92-4975-ad11-16c6c0f3524f tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706a24ca0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:23.144306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2153b4e7-0f92-4975-ad11-16c6c0f3524f tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 202 len: 0 microversion: 2.1 time: 0.067585 Sep 28 12:39:23.144880 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 588/1183] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 28 12:39:23 2022] DELETE /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:23.153649 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-273ef7f9-9273-440c-af95-a4ab8f98f9f5 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706cc8790>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:23.185641 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-273ef7f9-9273-440c-af95-a4ab8f98f9f5 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 200 len: 287 microversion: 2.1 time: 0.035730 Sep 28 12:39:23.186205 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 596/1184] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:23 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:39:24.199388 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ed38596-e746-46df-9c01-be507b7e7082 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706a44b80>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:24.223521 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-9ed38596-e746-46df-9c01-be507b7e7082 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] HTTP exception thrown: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ed38596-e746-46df-9c01-be507b7e7082 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Request method failure captured: Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 HTTP/1.1 Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNEB0rYwW23QO2CzztSiRI-nH8hCsLe15ORU2iK4m0VSEXWIFyDEFi6szW0SWHLX7XBkRP4aes8Yr9VUJRTdL_jM0hXas-9C3SJaVGJwpPiuiOwRXIcsMhb6K1-pGG5InSM4YKgwGte_bJSdFrYbgeRnlFOwmrK_8CC0b1ApmMYD3jCQ Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:39:24.227278 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0c5c56dbe064490e9b5cac5c2dffe7ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}] Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: ec194588607849b082ee07caa03c50a5 Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '609e5c5e-03fb-4fd7-9032-dec0aba72d98'} Sep 28 12:39:24.229036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. (HTTP 404) (Request-ID: req-e2871e80-8852-4351-9d11-380169025ace) Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.230213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:24.231847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 12:39:24.233509 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ed38596-e746-46df-9c01-be507b7e7082 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Returning 404 to user: Snapshot 609e5c5e-03fb-4fd7-9032-dec0aba72d98 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:24.235122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9ed38596-e746-46df-9c01-be507b7e7082 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98" status: 404 len: 111 microversion: 2.1 time: 0.033622 Sep 28 12:39:24.236175 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 589/1185] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 12:39:24 2022] GET /compute/v2.1/os-snapshots/609e5c5e-03fb-4fd7-9032-dec0aba72d98 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:24.237071 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9aea66d4-b90b-4e2e-86af-3b82d7291d85 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706d51550>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:24.298166 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9aea66d4-b90b-4e2e-86af-3b82d7291d85 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 202 len: 0 microversion: 2.1 time: 0.064634 Sep 28 12:39:24.298738 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 597/1186] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:39:24 2022] DELETE /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:24.307731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9edaeca3-af7a-4a2c-8513-4ffee191e0c4 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706a1b310>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:24.356540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9edaeca3-af7a-4a2c-8513-4ffee191e0c4 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 200 len: 345 microversion: 2.1 time: 0.052456 Sep 28 12:39:24.357147 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 590/1187] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:39:24 2022] GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:39:25.371669 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-98983f55-d47b-4d20-a5cc-f3a2f8c1c8fc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa707077430>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:25.399366 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-98983f55-d47b-4d20-a5cc-f3a2f8c1c8fc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] HTTP exception thrown: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-98983f55-d47b-4d20-a5cc-f3a2f8c1c8fc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Request method failure captured: Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 HTTP/1.1 Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNEB0rYwW23QO2CzztSiRI-nH8hCsLe15ORU2iK4m0VSEXWIFyDEFi6szW0SWHLX7XBkRP4aes8Yr9VUJRTdL_jM0hXas-9C3SJaVGJwpPiuiOwRXIcsMhb6K1-pGG5InSM4YKgwGte_bJSdFrYbgeRnlFOwmrK_8CC0b1ApmMYD3jCQ Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:39:25.401436 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0c5c56dbe064490e9b5cac5c2dffe7ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}] Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: ec194588607849b082ee07caa03c50a5 Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '87bbbb71-7da2-4f43-aa5e-fe84bfc545c1'} Sep 28 12:39:25.403141 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. (HTTP 404) (Request-ID: req-f6dcc550-438a-4339-bbed-82b93c91ae2c) Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.404196 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:25.405788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:39:25.407238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-98983f55-d47b-4d20-a5cc-f3a2f8c1c8fc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Returning 404 to user: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-98983f55-d47b-4d20-a5cc-f3a2f8c1c8fc tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 404 len: 109 microversion: 2.1 time: 0.035488 Sep 28 12:39:25.408922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 598/1188] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:39:25 2022] GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:25.418381 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29f06634-cc55-4ff3-85de-2abd30a42164 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706b26e50>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:25.445603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-29f06634-cc55-4ff3-85de-2abd30a42164 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] HTTP exception thrown: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29f06634-cc55-4ff3-85de-2abd30a42164 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Request method failure captured: Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 HTTP/1.1 Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjNEB0rYwW23QO2CzztSiRI-nH8hCsLe15ORU2iK4m0VSEXWIFyDEFi6szW0SWHLX7XBkRP4aes8Yr9VUJRTdL_jM0hXas-9C3SJaVGJwpPiuiOwRXIcsMhb6K1-pGG5InSM4YKgwGte_bJSdFrYbgeRnlFOwmrK_8CC0b1ApmMYD3jCQ Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:39:25.447860 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0c5c56dbe064490e9b5cac5c2dffe7ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}] Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: ec194588607849b082ee07caa03c50a5 Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '87bbbb71-7da2-4f43-aa5e-fe84bfc545c1'} Sep 28 12:39:25.449597 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. (HTTP 404) (Request-ID: req-405c5100-3ff4-435d-83c4-2cf0bcafce56) Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.450662 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:39:25.452234 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:39:25.453780 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29f06634-cc55-4ff3-85de-2abd30a42164 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Returning 404 to user: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:25.455244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-29f06634-cc55-4ff3-85de-2abd30a42164 tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 404 len: 109 microversion: 2.1 time: 0.035154 Sep 28 12:39:25.456265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 591/1189] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 12:39:25 2022] DELETE /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:25.457952 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-49002929-b642-4110-899b-1bc7747b18ff tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Calling method '.version_select at 0x7fa706da1790>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:25.487123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-49002929-b642-4110-899b-1bc7747b18ff tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] HTTP exception thrown: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-49002929-b642-4110-899b-1bc7747b18ff tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Request method failure captured: Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 HTTP/1.1 Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNEB0rYwW23QO2CzztSiRI-nH8hCsLe15ORU2iK4m0VSEXWIFyDEFi6szW0SWHLX7XBkRP4aes8Yr9VUJRTdL_jM0hXas-9C3SJaVGJwpPiuiOwRXIcsMhb6K1-pGG5InSM4YKgwGte_bJSdFrYbgeRnlFOwmrK_8CC0b1ApmMYD3jCQ Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:39:25.489042 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0c5c56dbe064490e9b5cac5c2dffe7ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0c5c56dbe064490e9b5cac5c2dffe7ac"}]}] Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: 0c5c56dbe064490e9b5cac5c2dffe7ac Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1779065979 Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: ec194588607849b082ee07caa03c50a5 Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1779065979-project Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '87bbbb71-7da2-4f43-aa5e-fe84bfc545c1'} Sep 28 12:39:25.490764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. (HTTP 404) (Request-ID: req-48d95b13-1e4e-4775-bd45-fe666689c138) Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.491859 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:39:25.493158 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:39:25.494451 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-49002929-b642-4110-899b-1bc7747b18ff tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] Returning 404 to user: Volume 87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-49002929-b642-4110-899b-1bc7747b18ff tempest-VolumesSnapshotsTestJSON-1779065979 tempest-VolumesSnapshotsTestJSON-1779065979-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1" status: 404 len: 109 microversion: 2.1 time: 0.036558 Sep 28 12:39:25.495737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 599/1190] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 12:39:25 2022] GET /compute/v2.1/os-volumes/87bbbb71-7da2-4f43-aa5e-fe84bfc545c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:39:49.643018 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:49.648409 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491896792", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1668387227", "security_groups": [{"name": "tempest-secgroup-smoke-1396524423"}], "block_device_mapping_v2": [{"uuid": "48e707c0-00da-4652-983d-fcd3a5b41575", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf8da1f-c122-40d9-8bf4-a166b5233ca8"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:39:49.762717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] validate_networks() for [('cbf8da1f-c122-40d9-8bf4-a166b5233ca8', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:39:50.157611 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:39:50.158028 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:39:50.158497 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:39:50.158894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:39:50.159365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:39:50.172839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:50.172839 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:50.173196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:50.173916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:50.174359 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:50.175574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:50.196254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:39:50.200288 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Getting quotas for user 5b723fcdba1d4b26bd0cf604d59f8d8c and project d73c25391e8044c2ac3678317021732d. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:39:50.258591 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:39:50.260829 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48e707c0-00da-4652-983d-fcd3a5b41575',volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:39:50.389910 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-73c7252b-5548-450a-b240-b6f602088340 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747836 Sep 28 12:39:50.390551 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 592/1191] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:39:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:39:50.403297 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-204987c0-dd56-4a73-acf8-50492dc18f45 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:50.403911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-204987c0-dd56-4a73-acf8-50492dc18f45 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:50.459458 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-204987c0-dd56-4a73-acf8-50492dc18f45 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:50.468680 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-204987c0-dd56-4a73-acf8-50492dc18f45 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1095 microversion: 2.1 time: 0.069967 Sep 28 12:39:50.469253 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 600/1192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:50 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:51.490896 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:51.491471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:51.499859 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:51.500337 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:51.500767 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:51.501485 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:51.501932 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:51.502351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:51.566328 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:51.574311 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a121cb4-9d0b-4b15-abad-4284f5033e1b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1193 microversion: 2.1 time: 0.087274 Sep 28 12:39:51.574879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 593/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:51 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:52.597842 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:52.598452 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:52.605584 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:52.606077 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:52.606510 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:52.607200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:52.607654 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:52.608078 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:52.667638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:52.675257 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-daa9c292-a473-44bd-8bb5-b0ab37afc760 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1211 microversion: 2.1 time: 0.081320 Sep 28 12:39:52.675818 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 601/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:52 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:53.698998 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:53.699606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:53.706187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:53.706666 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:53.707102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:53.707789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:53.708239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:53.708659 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:53.772083 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:53.779802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d816259d-8a7a-46f8-942d-726cf7b7cb88 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1211 microversion: 2.1 time: 0.084674 Sep 28 12:39:53.780353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 594/1195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:53 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:54.802624 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:54.803150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:54.809586 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:54.810065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:54.810497 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:54.811180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:54.811647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:54.812068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:54.871636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:54.879268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3266ed37-5d0d-42a1-882d-0aad5c4faa1a tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1211 microversion: 2.1 time: 0.080786 Sep 28 12:39:54.879834 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 602/1196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:54 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:39:55.902513 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:55.903104 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:55.909425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:55.909904 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:55.910344 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:55.911034 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:55.911550 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:55.911992 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:55.978612 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:55.986244 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-95e9bf9a-1bf3-4f56-a363-e16336104ca2 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1211 microversion: 2.1 time: 0.087547 Sep 28 12:39:55.986891 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 595/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:55 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:56.910016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45c5b7c-f121-47f3-a588-2760abefc309", "tag": "949b6acf-209f-47b7-b2c6-918ddfd6e937"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:39:56.920690 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:56.921193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:56.921625 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:56.933824 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] Creating event network-changed:949b6acf-209f-47b7-b2c6-918ddfd6e937 for instance a45c5b7c-f121-47f3-a588-2760abefc309 on hv-cinder-84456 Sep 28 12:39:56.939447 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-bb9bcfae-0ec0-4982-81cc-d31bf1c44ddf req-eb5ea710-471b-485f-b12f-1558eaf5a248 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173005 Sep 28 12:39:56.940045 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 603/1198] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:39:57.010067 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:57.011318 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:57.017879 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:57.018365 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:57.018800 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:57.019496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:57.020157 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:57.020577 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:57.215704 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:57.223342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4c337238-361a-4e2b-8346-2fc7dbf71622 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1279 microversion: 2.1 time: 0.217117 Sep 28 12:39:57.223908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 596/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:57 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:58.248765 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:58.249502 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:58.255608 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:58.256086 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:58.257159 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:58.258001 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:58.258456 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:58.258881 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:58.389498 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:58.397979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f0b44dcc-97f4-41f1-afca-892dba9ff440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.153212 Sep 28 12:39:58.398552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 604/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:58 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:59.421740 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:59.422410 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:59.429212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:59.429684 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:59.430113 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:59.430789 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:59.431235 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:59.431651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:59.569969 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:59.577634 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-40aebef7-469b-448c-afa7-35af68ef6862 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.159971 Sep 28 12:39:59.578196 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 597/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:59 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:00.602212 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:00.602865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:00.604955 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:00.610832 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:00.611404 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:00.611843 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:00.612553 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:00.613013 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:00.613481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:00.742450 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:00.750072 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-5099d525-6ab2-471c-b775-e170797960f4 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.152529 Sep 28 12:40:00.750642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 605/1202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:00 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:01.772962 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:01.773596 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:01.775526 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:01.776353 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:01.782805 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:01.783263 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:01.783691 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:01.784511 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:01.784951 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:01.785651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:01.958524 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:01.966505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e32e0849-3280-4afb-ad82-323d44809579 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.197910 Sep 28 12:40:01.967079 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 598/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:01 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:02.989522 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:02.990244 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:02.996668 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:02.997350 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:02.997869 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:02.998729 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:02.999271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:02.999757 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:03.138425 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:03.146320 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3f26eee7-9ec0-44cb-8989-b1627edef661 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.160927 Sep 28 12:40:03.147069 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 606/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:02 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:04.169621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:04.170315 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:04.177651 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:04.178840 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:04.179609 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:04.180833 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:04.181546 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:04.181988 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:04.329425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:04.337715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b314d077-bb7a-4a34-9c68-466aaa0a992f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.171902 Sep 28 12:40:04.338279 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 599/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:04 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:05.149535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-749104487", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "networks": [{"uuid": "43943534-e603-42f2-bee3-61bfafe2d491"}]}} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:05.203875 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.network.neutron [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] validate_networks() for [('43943534-e603-42f2-bee3-61bfafe2d491', None, None, None, None, None)] {{(pid=120393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:40:05.361866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:05.362714 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:05.369124 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:05.369872 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:05.370303 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:05.370984 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:05.371428 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:05.371848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:05.507713 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:05.516718 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-956eaa8e-152e-45dd-8850-f81cced1fceb tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.159325 Sep 28 12:40:05.517323 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 600/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:05 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:05.554385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Flavor limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:40:05.554813 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Image limits 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:40:05.555287 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Flavor pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:40:05.555731 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Image pref 0:0:0 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:40:05.556145 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.virt.hardware [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:40:05.564949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:05.565409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:05.565838 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:05.566596 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:05.567205 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:05.567461 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:05.584068 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Getting quotas for project a24baceb1473444fa611c71a7c8fb5ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:40:05.588580 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.quota [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Getting quotas for user 5097f22898f943f6a9a843048fa9c8b0 and project a24baceb1473444fa611c71a7c8fb5ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:40:05.600082 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Going to run 1 instances... {{(pid=120393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:40:05.602911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:40:05.650965 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-a2d5e7b2-80e4-4c51-86aa-59f941396c8c tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505760 Sep 28 12:40:05.651614 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 607/1207] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:40:05.663161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b930546f-155b-496d-b7e5-379c9433bc93 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:05.664145 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b930546f-155b-496d-b7e5-379c9433bc93 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:05.718486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b930546f-155b-496d-b7e5-379c9433bc93 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:05.726164 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b930546f-155b-496d-b7e5-379c9433bc93 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1213 microversion: 2.1 time: 0.066479 Sep 28 12:40:05.727284 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 601/1208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:05 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:06.540185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:06.540798 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:06.549454 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:06.549930 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:06.550358 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:06.551038 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:06.551488 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:06.551903 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:06.678774 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:06.686550 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bcc5fca9-2ca8-4f4e-b283-f271cedef00b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.150700 Sep 28 12:40:06.687104 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 608/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:06 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:06.749711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:06.750478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:06.757161 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:06.757661 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:06.758089 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:06.758774 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:06.759218 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:06.759632 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:06.838254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:06.847195 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3e5843b4-e4c7-4be5-a724-c964b7d5441f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1273 microversion: 2.1 time: 0.101525 Sep 28 12:40:06.847779 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 602/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:06 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:07.710220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:07.711543 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:07.718492 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:07.718979 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:07.719417 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:07.720109 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:07.720743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:07.721377 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:07.886708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:07.889977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45c5b7c-f121-47f3-a588-2760abefc309", "name": "network-vif-plugged", "status": "completed", "tag": "949b6acf-209f-47b7-b2c6-918ddfd6e937"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:07.895997 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d105cba8-4bd6-415c-be7f-b5ec493c8e3e tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.189669 Sep 28 12:40:07.897273 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 609/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:07 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:40:07.909394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:07.909394 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:07.909898 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:07.910410 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:07.910924 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:07.911857 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:07.912402 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:07.913059 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:07.917893 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:07.918389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:07.918834 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:07.932099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] Creating event network-vif-plugged:949b6acf-209f-47b7-b2c6-918ddfd6e937 for instance a45c5b7c-f121-47f3-a588-2760abefc309 on hv-cinder-84456 Sep 28 12:40:07.937868 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-a52158d0-b080-49f6-9276-da42936130d7 req-af2b97f3-0694-4d25-9a4e-d1ebdaba052d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201421 Sep 28 12:40:07.938897 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 603/1212] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:40:08.048607 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:08.057330 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d3cc0e04-1d57-4869-8d62-4dd14a5440c1 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.158844 Sep 28 12:40:08.058005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 610/1213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:07 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:08.224449 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e4feb1-fe06-40b1-add4-0835822d91f0", "tag": "4796a88c-edcd-4688-84f8-3d4d1e2a72a3"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:08.243930 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:08.245707 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:08.246926 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:08.261953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] Creating event network-changed:4796a88c-edcd-4688-84f8-3d4d1e2a72a3 for instance c5e4feb1-fe06-40b1-add4-0835822d91f0 on hv-cinder-84456 Sep 28 12:40:08.267043 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-67538d6b-7c86-4c72-b80a-c0f733b4fca6 req-6308115e-0e47-4e1a-88e0-eb1005459c82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046816 Sep 28 12:40:08.267639 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 604/1214] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:08.923830 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:08.924371 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:08.931429 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:08.931908 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:08.932336 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:08.933022 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:08.933503 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:08.933922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:09.066416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:09.073962 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-448acf6c-0582-4fa0-80b4-db48b130bbda tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1267 microversion: 2.1 time: 0.154094 Sep 28 12:40:09.074535 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 611/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:08 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:09.081536 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:09.082238 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:09.088804 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:09.089579 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:09.090016 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:09.090706 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:09.091166 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:09.091590 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:09.220385 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:09.228586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ce9c2fc8-e1be-40b6-8a99-cbdbeace5478 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.151179 Sep 28 12:40:09.229148 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 605/1216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:09 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:10.097043 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:10.097724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:10.104526 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.105016 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.105486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.106185 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.106646 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.107073 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.239799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:10.248422 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-ca6a3eff-4ff9-4ee0-ab00-0b8b24ed0467 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1454 microversion: 2.1 time: 0.155200 Sep 28 12:40:10.249004 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 612/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:10 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:10.251602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:10.252203 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:10.259091 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.259568 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.259981 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.260656 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.261098 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.261537 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.270645 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:10.271256 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:10.277188 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.277643 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.278075 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.278764 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:10.279221 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:10.279644 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:10.391393 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:10.399471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e0bd1d8-7b9f-4af0-bc9c-2287249b6824 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.151584 Sep 28 12:40:10.400044 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 606/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:10 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:40:10.409448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:10.417222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-41dad548-046f-4edc-935f-adcde2b6a6e8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1454 microversion: 2.1 time: 0.150239 Sep 28 12:40:10.417794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 613/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:10 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:40:11.422418 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:11.423024 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:11.429434 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:11.429914 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:11.430343 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:11.431038 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:11.431486 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:11.431905 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:11.567950 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:11.576041 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a4a896b9-5e29-4f30-aebf-1f8c5efb5da2 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.157449 Sep 28 12:40:11.576605 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 607/1220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:11 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:12.122922 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45c5b7c-f121-47f3-a588-2760abefc309", "tag": "949b6acf-209f-47b7-b2c6-918ddfd6e937"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:12.132826 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:12.133357 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:12.133791 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:12.144566 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] Creating event network-changed:949b6acf-209f-47b7-b2c6-918ddfd6e937 for instance a45c5b7c-f121-47f3-a588-2760abefc309 on hv-cinder-84456 Sep 28 12:40:12.150139 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-37bc2827-fbc4-47b2-9fcd-b01adf5d3edd req-899dafea-0fec-462d-9a5e-f003d326a881 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088731 Sep 28 12:40:12.150880 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 614/1221] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:12.600499 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:12.601378 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:12.610907 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:12.611602 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:12.612192 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:12.613084 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:12.613716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:12.614292 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:12.807355 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:12.815265 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-74288e69-1543-4833-88f2-feaf180cc46a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.219204 Sep 28 12:40:12.816142 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 608/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:12 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:13.841800 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:13.842499 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:13.848719 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:13.849313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:13.850380 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:13.851324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:13.851790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:13.852215 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:13.986008 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:13.994271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-1eea6ad9-bd77-4928-8a4e-8e3609d8139b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.157468 Sep 28 12:40:13.994835 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 615/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:13 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:15.018585 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:15.019193 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:15.026187 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:15.026667 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:15.027102 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:15.027857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:15.028301 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:15.028716 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:15.159372 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:15.167053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b7736a79-7535-48ff-8a46-ccbfbfec888f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.152671 Sep 28 12:40:15.167621 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 609/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:15 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:15.799180 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e4feb1-fe06-40b1-add4-0835822d91f0", "name": "network-vif-plugged", "status": "completed", "tag": "4796a88c-edcd-4688-84f8-3d4d1e2a72a3"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:15.804743 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:15.805445 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=6 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:15.811247 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:15.811737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:15.812165 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:15.824220 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] Creating event network-vif-plugged:4796a88c-edcd-4688-84f8-3d4d1e2a72a3 for instance c5e4feb1-fe06-40b1-add4-0835822d91f0 on hv-cinder-84456 Sep 28 12:40:15.829123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-58bcb2e8-83b6-42fc-9fa0-1efa35009db4 req-026ca1a9-b45e-476d-8633-daecd448f170 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033611 Sep 28 12:40:15.829833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 616/1225] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:16.189838 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:16.190450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:16.192460 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:16.198952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:16.199461 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:16.199895 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:16.200578 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:16.201032 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:16.201478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:16.330145 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:16.337775 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45924d66-8748-4e07-81fa-b2cb5c85e155 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.151781 Sep 28 12:40:16.338336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 610/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:16 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:17.361970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:17.362603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:17.368794 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:17.369306 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:17.369736 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:17.370416 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:17.370863 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:17.371280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:17.500130 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:17.508495 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-f062da7f-039b-4c2e-9fc0-2fb11433034a tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1313 microversion: 2.1 time: 0.151257 Sep 28 12:40:17.509249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 617/1227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:17 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:18.532033 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:18.532640 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:18.539847 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:18.540322 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:18.540757 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:18.541464 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:18.541918 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:18.542336 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:18.559890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:18.669239 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:18.676802 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3e0882a7-9c8b-4edf-b2d6-fa11fac88612 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1498 microversion: 2.1 time: 0.148632 Sep 28 12:40:18.677411 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 611/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:18 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:19.161214 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:19.161711 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:19.169312 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:19.169797 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:19.170238 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:19.170933 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:19.171385 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:19.171802 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:19.198140 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Going to try to terminate instance {{(pid=120393) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:40:19.241040 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:19.274639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-50448493-0eb6-4d35-8469-ac6c4b21d144 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 204 len: 0 microversion: 2.1 time: 0.116729 Sep 28 12:40:19.275243 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 618/1229] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:40:19 2022] DELETE /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:40:19.283364 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:19.283973 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:19.290042 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:19.290519 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:19.290953 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:19.291637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:19.292105 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:19.292506 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:19.425435 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:19.433165 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5e14de60-ad23-4532-adcb-409610d16e2b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1504 microversion: 2.1 time: 0.153538 Sep 28 12:40:19.433715 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 612/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:19 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:20.457868 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:20.458593 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:20.461639 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:20.466969 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:20.467448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:20.467882 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:20.468565 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:20.469021 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:20.469472 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:20.602391 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:20.610564 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9e115c7d-cc92-4328-ad0e-6b66e340d697 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1504 microversion: 2.1 time: 0.156965 Sep 28 12:40:20.611123 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 619/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:20 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:21.635319 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:21.635911 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e4feb1-fe06-40b1-add4-0835822d91f0", "name": "network-vif-deleted", "tag": "4796a88c-edcd-4688-84f8-3d4d1e2a72a3"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:21.636999 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:21.639467 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:21.644219 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:21.644705 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:21.645162 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:21.645878 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:21.646335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:21.646724 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:21.646920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:21.647211 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:21.647820 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:21.672630 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] Creating event network-vif-deleted:4796a88c-edcd-4688-84f8-3d4d1e2a72a3 for instance c5e4feb1-fe06-40b1-add4-0835822d91f0 on hv-cinder-84456 Sep 28 12:40:21.677642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-3afd3003-d21d-4873-875e-5c2b62fe3718 req-2b9a82a2-5f7c-4b88-bc02-5c1fdb729dd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046024 Sep 28 12:40:21.678271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 620/1232] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:40:21.716781 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:21.726586 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7c23cf5a-4ef5-44b1-8d74-61e6835ce72f tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 200 len: 1462 microversion: 2.1 time: 0.095890 Sep 28 12:40:21.727197 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 613/1233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:21 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:22.750994 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:22.751603 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: c5e4feb1-fe06-40b1-add4-0835822d91f0] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:22.757682 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:22.758143 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:22.758572 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:22.759249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:22.759701 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:22.760114 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:22.772844 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] HTTP exception thrown: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Request method failure captured: Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 HTTP/1.1 Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNECj_3CE8115czz5LJXogQZDvosQtsepcGTL_IgyOyx-WFsTEjEU4_oiy8FarxxihW5LOVQ9F7OW1SPHLB2TZToI70BZFeoW34anlrRnUOYy1o5cNRZjj8MdxAMVYY0iOQJzLk3-xVf1M31ggk4_uGt0dxwlBeQx3ol7XgCrUhr-WEQ Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a24baceb1473444fa611c71a7c8fb5ae Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:40:22.774448 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a24baceb1473444fa611c71a7c8fb5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a24baceb1473444fa611c71a7c8fb5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a24baceb1473444fa611c71a7c8fb5ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a24baceb1473444fa611c71a7c8fb5ae"}]}] Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a24baceb1473444fa611c71a7c8fb5ae Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesActionsTest-1709011938-project Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 5097f22898f943f6a9a843048fa9c8b0 Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesActionsTest-1709011938-project Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. Sep 28 12:40:22.777162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'c5e4feb1-fe06-40b1-add4-0835822d91f0'} Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:40:22.778364 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. Sep 28 12:40:22.780053 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:22.781558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Returning 404 to user: Instance c5e4feb1-fe06-40b1-add4-0835822d91f0 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:40:22.781558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-9da417c0-1bbf-4668-a552-65d19f61df51 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0" status: 404 len: 111 microversion: 2.1 time: 0.030093 Sep 28 12:40:22.781558 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 621/1234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:22 2022] GET /compute/v2.1/servers/c5e4feb1-fe06-40b1-add4-0835822d91f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:40:22.827168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-534520114", "imageRef": "99602f32-0464-4d43-acf1-55f414e15b2a", "flavorRef": "452", "networks": [{"uuid": "43943534-e603-42f2-bee3-61bfafe2d491"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:22.880023 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] validate_networks() for [('43943534-e603-42f2-bee3-61bfafe2d491', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:40:23.279109 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:40:23.279525 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:40:23.279991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:40:23.280422 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:40:23.280823 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:40:23.289574 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:23.290047 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:23.290471 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:23.291717 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:23.292160 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:23.292573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:23.309299 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Getting quotas for project a24baceb1473444fa611c71a7c8fb5ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:40:23.313155 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Getting quotas for user 5097f22898f943f6a9a843048fa9c8b0 and project a24baceb1473444fa611c71a7c8fb5ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:40:23.323790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:40:23.326152 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99602f32-0464-4d43-acf1-55f414e15b2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:40:23.372274 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e1f53fee-58a7-4693-b0be-9bebf5802db3 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548846 Sep 28 12:40:23.372911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 614/1235] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 12:40:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:40:23.383981 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-71ded471-8c22-4f4c-a665-3bf3edd986ec tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:23.384709 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-71ded471-8c22-4f4c-a665-3bf3edd986ec tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:23.438126 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-71ded471-8c22-4f4c-a665-3bf3edd986ec tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:23.445105 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-71ded471-8c22-4f4c-a665-3bf3edd986ec tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1213 microversion: 2.1 time: 0.064886 Sep 28 12:40:23.445723 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 622/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:23 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:24.468970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:24.469726 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:24.480053 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:24.480788 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:24.481262 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:24.481965 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:24.482412 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:24.482854 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:24.583750 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:24.591821 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4ecd1f8-1b39-4f16-87cc-6ccc541a1559 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1273 microversion: 2.1 time: 0.127794 Sep 28 12:40:24.592581 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 615/1237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:24 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:25.615935 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:25.616647 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:25.624023 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:25.624514 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:25.624982 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:25.625719 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:25.626163 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:25.626587 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:25.762005 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:25.769722 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e48b3db6-8076-4123-9b5d-f3771509f4be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.157709 Sep 28 12:40:25.770293 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 623/1238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:25 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:40:25.879306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4120ca73-da96-4dfc-b11e-04c40e1b282a", "tag": "d71fdd69-1f1a-491c-a2d0-b3678f2ccd58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:25.891653 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:25.892130 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:25.892688 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:25.904618 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] Creating event network-changed:d71fdd69-1f1a-491c-a2d0-b3678f2ccd58 for instance 4120ca73-da96-4dfc-b11e-04c40e1b282a on hv-cinder-84456 Sep 28 12:40:25.909708 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-5d686975-0616-4e09-96cb-3f25d038ea35 req-12ee815c-e01d-4369-a852-d18ed4a7e3b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Sep 28 12:40:25.910351 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 616/1239] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:26.793583 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:26.794169 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:26.800604 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:26.801081 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:26.801559 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:26.802240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:26.802689 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:26.803116 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:26.929154 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:26.937411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-4b304b2a-eff1-4c93-bc27-cf519ba9a25d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.147721 Sep 28 12:40:26.937970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 624/1240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:26 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:27.961120 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:27.961833 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:27.968866 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:27.969399 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:27.969832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:27.970508 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:27.970955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:27.971370 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:28.097030 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:28.105280 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb800eb6-e12c-49b6-a681-5feec9f783d0 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.148774 Sep 28 12:40:28.105841 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 617/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:27 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:29.127945 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:29.128573 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:29.135160 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:29.135638 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:29.136099 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:29.137083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:29.137280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:29.137703 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:29.268833 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:29.277694 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e41bc134-af99-4c57-b2e7-1e581f9cc643 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.153480 Sep 28 12:40:29.278480 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 625/1242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:29 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:30.301848 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:30.302458 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:30.309362 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:30.309832 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:30.310257 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:30.310934 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:30.311376 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:30.311790 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:30.444658 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:30.452931 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0c789c3d-dbe5-493b-9cdd-1bbe31a9780d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.155019 Sep 28 12:40:30.453565 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 618/1243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:30 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:31.476162 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:31.476768 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:31.483033 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:31.483505 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:31.483941 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:31.484651 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:31.485100 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:31.485544 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:31.613427 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:31.620974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-6be4e1f2-79ad-43af-9a07-69a4f9710841 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.148635 Sep 28 12:40:31.621563 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 626/1244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:31 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:31.860210 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4120ca73-da96-4dfc-b11e-04c40e1b282a", "name": "network-vif-plugged", "status": "completed", "tag": "d71fdd69-1f1a-491c-a2d0-b3678f2ccd58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:31.870342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:31.870817 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:31.871243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:31.882345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] Creating event network-vif-plugged:d71fdd69-1f1a-491c-a2d0-b3678f2ccd58 for instance 4120ca73-da96-4dfc-b11e-04c40e1b282a on hv-cinder-84456 Sep 28 12:40:31.887389 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-9eae10be-d1ce-4256-8945-46e304fe2980 req-388b4c9b-96b0-4ebb-8197-405a8f82a3e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030782 Sep 28 12:40:31.887977 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 619/1245] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:32.644398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:32.645031 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:32.651496 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:32.651974 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:32.652401 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:32.653080 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:32.653552 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:32.653970 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:32.781788 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:32.789383 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-e365b175-d59b-42f8-93eb-383dedeeb6be tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.148811 Sep 28 12:40:32.789948 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 627/1246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:32 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:33.810954 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:33.811630 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:33.815859 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:33.816540 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:33.823496 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:33.823970 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:33.824398 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:33.825077 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:33.825544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:33.825959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:33.957959 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:33.966890 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-223d0c7f-394c-421b-b558-edebb43c9c7b tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1313 microversion: 2.1 time: 0.157381 Sep 28 12:40:33.967476 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 620/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:33 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:34.991595 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:34.992206 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:34.994752 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell0:SELECT=2 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:40:35.000282 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.000790 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.001250 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.001940 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.002392 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.002812 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.137411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:35.145002 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-b31d59d9-d638-4cfc-9867-063ca4f9dd64 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1497 microversion: 2.1 time: 0.157340 Sep 28 12:40:35.145599 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:34 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:35.701114 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:35.701637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:35.707876 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.708347 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.708771 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.709478 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.709919 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.710332 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.735603 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:40:35.810693 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-39e803c2-bf24-4221-b655-515997f60a9d tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 204 len: 0 microversion: 2.1 time: 0.113327 Sep 28 12:40:35.811290 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 621/1249] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:40:35 2022] DELETE /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:40:35.820283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:35.820896 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:35.827891 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.828376 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.828813 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.829538 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:35.829998 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:35.830428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:35.954943 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:35.962622 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-3a194ee1-b626-4039-bfb6-e7593012e4ab tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1503 microversion: 2.1 time: 0.146194 Sep 28 12:40:35.963193 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 629/1250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:35 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:36.988423 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:36.989121 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:36.996254 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:36.996724 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:36.997177 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:36.997865 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:36.998313 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:36.998731 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:37.127212 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:37.135614 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cfe91952-e815-4276-a158-cf9c85ff03a7 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1503 microversion: 2.1 time: 0.151529 Sep 28 12:40:37.136173 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 622/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:36 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:37.968200 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4120ca73-da96-4dfc-b11e-04c40e1b282a", "name": "network-vif-deleted", "tag": "d71fdd69-1f1a-491c-a2d0-b3678f2ccd58"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:40:37.980313 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:37.980796 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:37.981280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:38.002226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] Creating event network-vif-deleted:d71fdd69-1f1a-491c-a2d0-b3678f2ccd58 for instance 4120ca73-da96-4dfc-b11e-04c40e1b282a on hv-cinder-84456 Sep 28 12:40:38.008773 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-0d97562d-1648-4f95-b10b-9bedd5c4be53 req-11b17bea-2c0a-45b0-b14e-7ee1326ce01e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044321 Sep 28 12:40:38.009770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 630/1252] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:40:38.158472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:38.159095 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:38.165224 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:38.165857 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:38.166296 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:38.166991 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:38.167472 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:38.167894 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:38.199698 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:38.200174 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:38.200679 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:38.201213 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lazy-loading 'fault' on Instance uuid 4120ca73-da96-4dfc-b11e-04c40e1b282a {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:40:38.242952 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097f22898f943f6a9a843048fa9c8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24baceb1473444fa611c71a7c8fb5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:40:38.250908 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fe2df639-d3cb-4cb5-a58a-8033b96e0d40 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 200 len: 1303 microversion: 2.1 time: 0.096227 Sep 28 12:40:38.251450 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 623/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:38 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:40:39.275504 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:40:39.276181 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] [instance: 4120ca73-da96-4dfc-b11e-04c40e1b282a] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:40:39.282271 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:39.282748 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:39.283175 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:39.283851 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:40:39.284296 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:40:39.284708 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:40:39.297753 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] HTTP exception thrown: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Request method failure captured: Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a HTTP/1.1 Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjNECj_3CE8115czz5LJXogQZDvosQtsepcGTL_IgyOyx-WFsTEjEU4_oiy8FarxxihW5LOVQ9F7OW1SPHLB2TZToI70BZFeoW34anlrRnUOYy1o5cNRZjj8MdxAMVYY0iOQJzLk3-xVf1M31ggk4_uGt0dxwlBeQx3ol7XgCrUhr-WEQ Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: a24baceb1473444fa611c71a7c8fb5ae Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:40:39.299335 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a24baceb1473444fa611c71a7c8fb5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a24baceb1473444fa611c71a7c8fb5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a24baceb1473444fa611c71a7c8fb5ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a24baceb1473444fa611c71a7c8fb5ae"}]}] Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: a24baceb1473444fa611c71a7c8fb5ae Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-VolumesActionsTest-1709011938 Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-VolumesActionsTest-1709011938-project Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 5097f22898f943f6a9a843048fa9c8b0 Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-VolumesActionsTest-1709011938-project Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. Sep 28 12:40:39.301083 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': '4120ca73-da96-4dfc-b11e-04c40e1b282a'} Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:40:39.302374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. Sep 28 12:40:39.304101 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:40:39.306486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] Returning 404 to user: Instance 4120ca73-da96-4dfc-b11e-04c40e1b282a could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:40:39.306486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-2a947e94-58b7-4bf2-a8e1-63f4084bfa57 tempest-VolumesActionsTest-1709011938 tempest-VolumesActionsTest-1709011938-project] 10.222.0.60 "GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a" status: 404 len: 111 microversion: 2.1 time: 0.029972 Sep 28 12:40:39.306486 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 631/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:40:39 2022] GET /compute/v2.1/servers/4120ca73-da96-4dfc-b11e-04c40e1b282a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:42:27.546484 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff816e53-bde7-40b1-b4a7-6a77dbedbf79] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:42:27.547515 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:42:27.548310 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:42:27.549280 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913c8fd4-788b-4907-ad67-be7e16348fe6] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:42:27.549725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:42:27.549725 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Wed Sep 28 12:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 (ip 10.222.0.60) !!! Sep 28 12:42:27.553249 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45c5b7c-f121-47f3-a588-2760abefc309", "tag": "949b6acf-209f-47b7-b2c6-918ddfd6e937"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:42:27.557158 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:27.557685 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:27.558770 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:42:27.558984 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Wed Sep 28 12:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 28 12:42:27.560476 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_api:SELECT=27 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:42:27.561190 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG dbcounter [-] [120393] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=120393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:42:27.569845 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:27.570517 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:27.570949 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:27.576383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:27.576383 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:27.577573 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:27.578379 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:27.578881 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:27.579335 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:27.583632 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] Creating event network-changed:949b6acf-209f-47b7-b2c6-918ddfd6e937 for instance a45c5b7c-f121-47f3-a588-2760abefc309 on hv-cinder-84456 Sep 28 12:42:27.589389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-adb7a34b-47c7-4c91-a3f3-f8f48262cdb7 req-6973ab32-0ac0-4382-8914-d31dc2cf705c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041772 Sep 28 12:42:27.590226 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 632/1255] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:42:27.610226 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:42:27.692911 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-14f4bf31-5caf-433e-9a34-c3511bf4d440 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 204 len: 0 microversion: 2.1 time: 0.148814 Sep 28 12:42:27.693641 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 624/1256] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:42:27 2022] DELETE /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:42:27.703636 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:27.704325 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:27.711411 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:27.711892 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:27.712324 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:27.713274 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:27.713737 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:27.714151 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:27.852986 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:42:27.861468 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-24cfba8c-4ff5-4112-992b-77c75e0684c7 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1578 microversion: 2.1 time: 0.162254 Sep 28 12:42:27.862034 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 633/1257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:27 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:42:28.886217 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:28.886935 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:28.895681 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:28.896156 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:28.896582 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:28.897306 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:28.897751 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:28.898168 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:28.903650 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff816e53-bde7-40b1-b4a7-6a77dbedbf79] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40652. Sep 28 12:42:29.097326 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:42:29.104912 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4696a37-e2a1-4aa1-ad8a-881a8e3c9718 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1578 microversion: 2.1 time: 0.223017 Sep 28 12:42:29.105505 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 625/1258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:28 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:42:30.060065 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45c5b7c-f121-47f3-a588-2760abefc309", "name": "network-vif-deleted", "tag": "949b6acf-209f-47b7-b2c6-918ddfd6e937"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:42:30.072384 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:30.072865 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:30.073351 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:30.085501 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO oslo.messaging._drivers.impl_rabbit [-] [913c8fd4-788b-4907-ad67-be7e16348fe6] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40658. Sep 28 12:42:30.088292 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] Creating event network-vif-deleted:949b6acf-209f-47b7-b2c6-918ddfd6e937 for instance a45c5b7c-f121-47f3-a588-2760abefc309 on hv-cinder-84456 Sep 28 12:42:30.094428 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-5d721818-f150-4504-92e9-7b25ef0c852a req-3cfd3315-6dc1-4512-bc03-cc983696ae7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038284 Sep 28 12:42:30.095024 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 634/1259] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:42:30.127955 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:30.128563 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:30.136014 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:30.136492 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:30.136920 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:30.137637 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:30.138080 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:30.138502 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:30.200712 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:42:30.209243 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a8f9a7fe-0fc5-4b2f-8b24-770e6b1244f5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 200 len: 1226 microversion: 2.1 time: 0.085212 Sep 28 12:42:30.209809 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 626/1260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:30 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:42:31.232758 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:31.234117 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: a45c5b7c-f121-47f3-a588-2760abefc309] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:31.240150 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:31.240628 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:31.241063 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:31.241772 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:31.242219 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:31.242637 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:31.255421 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] HTTP exception thrown: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Request method failure captured: Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 HTTP/1.1 Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND8bTXKNWF6IWfkeBJZ9XJznGKn9rnqr9NODBkflTQQGZw7oE85IzlT6EaIpyinl6iTjFp2Vx6Rhv3EkLe033mniqlj1BC2cwvwC-QFta5buyPnZFkVYCAP-iIFYiEF9ND7B0eJjq1Jwpk1CQwQoPhZVOFuhuHqDHK1NjMKeW6R7G5w Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:42:31.257003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d73c25391e8044c2ac3678317021732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d73c25391e8044c2ac3678317021732d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}] Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 5b723fcdba1d4b26bd0cf604d59f8d8c Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. Sep 28 12:42:31.258822 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'a45c5b7c-f121-47f3-a588-2760abefc309'} Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:42:31.259725 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. Sep 28 12:42:31.261389 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:31.262890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Returning 404 to user: Instance a45c5b7c-f121-47f3-a588-2760abefc309 could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:42:31.262890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-29bf9ee6-d9fd-4083-8439-f863504e6c7b tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309" status: 404 len: 111 microversion: 2.1 time: 0.030333 Sep 28 12:42:31.262890 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 635/1261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:31 2022] GET /compute/v2.1/servers/a45c5b7c-f121-47f3-a588-2760abefc309 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:42:34.303122 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:34.304289 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:34.305687 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9459b4-bb4a-4835-bcc2-8103c94e6149", "tag": "c1437638-56f9-420a-bb35-7051efebc13d"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:42:34.310864 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:34.311352 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:34.311883 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:34.312798 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:34.313285 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:34.313711 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:34.318832 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:34.319432 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:34.320106 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:34.333240 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] Creating event network-changed:c1437638-56f9-420a-bb35-7051efebc13d for instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 on hv-cinder-84456 Sep 28 12:42:34.339317 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-8a5a694e-02c6-4d2f-b4bb-0ceabd9aa972 req-818c0aa7-d11d-4e41-968c-e858b02aaf25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037131 Sep 28 12:42:34.340356 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 636/1262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:42:34.342373 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:42:34.434035 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dacf55bd-9587-4fd0-b5cb-abd4a0b0426f tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 204 len: 0 microversion: 2.1 time: 0.134841 Sep 28 12:42:34.438778 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 627/1263] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:42:34 2022] DELETE /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:42:34.445222 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:34.445917 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:34.452786 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:34.453742 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:34.454203 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:34.454899 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:34.455346 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:34.456003 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:34.596289 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.policy [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120393) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:42:34.604181 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-76d3f63e-360f-4cdc-9aa5-cc187d9cb99d tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1576 microversion: 2.1 time: 0.163457 Sep 28 12:42:34.604755 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 637/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:34 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:42:35.628345 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:35.629093 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:35.635099 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:35.635580 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:35.636003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:35.636686 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:35.637150 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:35.637570 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:35.877251 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b723fcdba1d4b26bd0cf604d59f8d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c25391e8044c2ac3678317021732d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:42:35.886036 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a8eeb3d4-a228-4761-9d71-a480a0afb2e5 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 200 len: 1458 microversion: 2.1 time: 0.262230 Sep 28 12:42:35.886606 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 628/1265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:35 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 1458 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:42:35.888532 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9459b4-bb4a-4835-bcc2-8103c94e6149", "name": "network-vif-deleted", "tag": "c1437638-56f9-420a-bb35-7051efebc13d"}]} {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:42:35.899578 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:35.900057 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:35.900481 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:35.911712 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.compute.server_external_events [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] Creating event network-vif-deleted:c1437638-56f9-420a-bb35-7051efebc13d for instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 on hv-cinder-84456 Sep 28 12:42:35.916283 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [req-360e413d-d3ef-4a29-a61c-925a2881ff3a req-2aea9841-e39e-41f6-af4d-f43f84b0b452 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Sep 28 12:42:35.916850 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 638/1266] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 12:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:42:36.910615 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:36.911183 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: 8b9459b4-bb4a-4835-bcc2-8103c94e6149] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:36.917548 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:36.918021 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:36.918448 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:36.919119 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:36.919592 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:36.920008 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:36.933103 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] HTTP exception thrown: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Request method failure captured: Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 HTTP/1.1 Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND8bTXKNWF6IWfkeBJZ9XJznGKn9rnqr9NODBkflTQQGZw7oE85IzlT6EaIpyinl6iTjFp2Vx6Rhv3EkLe033mniqlj1BC2cwvwC-QFta5buyPnZFkVYCAP-iIFYiEF9ND7B0eJjq1Jwpk1CQwQoPhZVOFuhuHqDHK1NjMKeW6R7G5w Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:42:36.934730 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d73c25391e8044c2ac3678317021732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d73c25391e8044c2ac3678317021732d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}] Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 5b723fcdba1d4b26bd0cf604d59f8d8c Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. Sep 28 12:42:36.936544 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': '8b9459b4-bb4a-4835-bcc2-8103c94e6149'} Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:42:36.937852 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. Sep 28 12:42:36.939465 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:36.940916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Returning 404 to user: Instance 8b9459b4-bb4a-4835-bcc2-8103c94e6149 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:42:36.940916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e252f6e6-976b-4bf8-9bc0-c3aaa980eb32 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149" status: 404 len: 111 microversion: 2.1 time: 0.029392 Sep 28 12:42:36.940916 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 629/1267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:36 2022] GET /compute/v2.1/servers/8b9459b4-bb4a-4835-bcc2-8103c94e6149 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:42:37.369744 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:37.370328 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.compute.api [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120393) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:37.377315 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:37.377803 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:37.378237 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:37.378923 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:37.379374 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:37.379799 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG oslo_concurrency.lockutils [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:37.393398 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.wsgi [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] HTTP exception thrown: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Request method failure captured: Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: request: DELETE /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f HTTP/1.1 Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept: application/json Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Accept-Encoding: identity Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Connection: close Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Length: 0 Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Content-Type: application/json Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Host: 10.222.0.60 Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: Openstack-System-Scope: None Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: User-Agent: python-urllib3/1.26.12 Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Auth-Token: gAAAAABjND8bTXKNWF6IWfkeBJZ9XJznGKn9rnqr9NODBkflTQQGZw7oE85IzlT6EaIpyinl6iTjFp2Vx6Rhv3EkLe033mniqlj1BC2cwvwC-QFta5buyPnZFkVYCAP-iIFYiEF9ND7B0eJjq1Jwpk1CQwQoPhZVOFuhuHqDHK1NjMKeW6R7G5w Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Id: None Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Domain-Name: None Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Identity-Status: Confirmed Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Is-Admin-Project: True Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Id: default Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Domain-Name: Default Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Project-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Role: member,reader Sep 28 12:42:37.395012 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Roles: member,reader Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d73c25391e8044c2ac3678317021732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d73c25391e8044c2ac3678317021732d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}] Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Id: default Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Domain-Name: Default Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Id: 5b723fcdba1d4b26bd0cf604d59f8d8c Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: X-User-Name: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: method: > Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: exception: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.396733 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: action_args: {'id': 'de20408b-1f47-488b-976f-f41706a8509f'} Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:42:37.397816 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.399409 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.401085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Returning 404 to user: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. {{(pid=120393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:42:37.401085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-bcac4dbd-c69d-4775-8cc7-e7aaa3fe7c47 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 404 len: 111 microversion: 2.1 time: 0.031364 Sep 28 12:42:37.401085 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 639/1268] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 12:42:37 2022] DELETE /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:42:37.405189 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:37.405923 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] [instance: de20408b-1f47-488b-976f-f41706a8509f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:42:37.411948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:37.412425 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:37.412853 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:37.413559 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Acquiring lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:42:37.414003 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:42:37.414421 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Lock "1c0678a2-15f0-4f0b-96bc-ec6c4ee43f7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:42:37.427813 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] HTTP exception thrown: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Request method failure captured: Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f HTTP/1.1 Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept: application/json Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Connection: close Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Length: 0 Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Content-Type: application/json Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Host: 10.222.0.60 Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjND8bTXKNWF6IWfkeBJZ9XJznGKn9rnqr9NODBkflTQQGZw7oE85IzlT6EaIpyinl6iTjFp2Vx6Rhv3EkLe033mniqlj1BC2cwvwC-QFta5buyPnZFkVYCAP-iIFYiEF9ND7B0eJjq1Jwpk1CQwQoPhZVOFuhuHqDHK1NjMKeW6R7G5w Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Role: member,reader Sep 28 12:42:37.429342 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d73c25391e8044c2ac3678317021732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d73c25391e8044c2ac3678317021732d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d73c25391e8044c2ac3678317021732d"}]}] Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Id: d73c25391e8044c2ac3678317021732d Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945043014 Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Id: 5b723fcdba1d4b26bd0cf604d59f8d8c Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-1945043014-project Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: method: > Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: exception: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.431128 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: action_args: {'id': 'de20408b-1f47-488b-976f-f41706a8509f'} Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:42:37.432282 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. Sep 28 12:42:37.433948 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Sep 28 12:42:37.435518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Returning 404 to user: Instance de20408b-1f47-488b-976f-f41706a8509f could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:42:37.435518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-843c771f-7764-423a-b7e0-a175f5e88d37 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f" status: 404 len: 111 microversion: 2.1 time: 0.029679 Sep 28 12:42:37.435518 dv-cinder-844563-9-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 630/1269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 12:42:37 2022] GET /compute/v2.1/servers/de20408b-1f47-488b-976f-f41706a8509f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:42:38.718642 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: DEBUG nova.api.openstack.wsgi [None req-d36fd2b6-4f37-4321-802f-e8d1ef3b4bd8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] Calling method '.version_select at 0x7fa706da9430>' {{(pid=120393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:42:38.741741 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: INFO nova.api.openstack.requestlog [None req-d36fd2b6-4f37-4321-802f-e8d1ef3b4bd8 tempest-TestVolumeBootPattern-1945043014 tempest-TestVolumeBootPattern-1945043014-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1668387227" status: 202 len: 0 microversion: 2.1 time: 0.026943 Sep 28 12:42:38.742268 dv-cinder-844563-9-iscsi devstack@n-api.service[120393]: [pid: 120393|app: 0|req: 640/1270] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 28 12:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1668387227 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)